Jul 11 18:32:42 devstack cinder-volume[76108]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 18:32:42 devstack cinder-volume[76108]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 18:32:42 devstack cinder-volume[76108]: we strongly recommend against using it for new projects. Jul 11 18:32:42 devstack cinder-volume[76108]: If you are already using Eventlet, we recommend migrating to a different Jul 11 18:32:42 devstack cinder-volume[76108]: framework. For more detail see Jul 11 18:32:42 devstack cinder-volume[76108]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 18:32:42 devstack cinder-volume[76108]: import eventlet # noqa Jul 11 18:32:44 devstack cinder-volume[76108]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:32:44 devstack cinder-volume[76108]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:32:44 devstack cinder-volume[76108]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:32:45 devstack cinder-volume[76108]: INFO dbcounter [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Registered counter for database cinder Jul 11 18:32:45 devstack cinder-volume[76108]: DEBUG oslo_db.sqlalchemy.engines [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76108) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG dbcounter [-] [76108] Writer thread running {{(pid=76108) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:32:46 devstack cinder-volume[76108]: INFO cinder.rpc [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 18:32:46 devstack cinder-volume[76108]: INFO cinder.rpc [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_db.sqlalchemy.engines [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76108) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:32:46 devstack cinder-volume[76108]: INFO cinder.volume.manager [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Determined volume DB was empty at startup. Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG cinder.volume.manager [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76108) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 18:32:46 devstack cinder-volume[76108]: INFO cinder.volume.manager [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 11 18:32:46 devstack cinder-volume[76108]: WARNING stevedore.named [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 18:32:46 devstack cinder-volume[76108]: WARNING castellan.key_manager [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:32:46 devstack cinder-volume[76108]: WARNING cinder.keymgr.conf_key_mgr [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG cinder.volume.drivers.lvm [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76108) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_concurrency.processutils [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_concurrency.processutils [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] CMD "cinder-rtstool verify" returned: 0 in 0.413s {{(pid=76108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_db.sqlalchemy.engines [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76108) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:32:46 devstack cinder-volume[76108]: INFO cinder.rpc [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 11 18:32:46 devstack cinder-volume[76108]: INFO cinder.rpc [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 11 18:32:46 devstack cinder-volume[76108]: WARNING stevedore.named [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 18:32:46 devstack cinder-volume[76108]: WARNING castellan.key_manager [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:32:46 devstack cinder-volume[76108]: INFO cinder.volume.manager [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_db.sqlalchemy.engines [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76108) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:32:46 devstack cinder-volume[76108]: INFO oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Starting 1 workers Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Started child 76317 {{(pid=76108) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Full set of CONF: {{(pid=76108) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] ******************************************************************************** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Configuration options gathered from: {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] ================================================================================ {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] allow_availability_zone_fallback = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] allow_compression_on_image_upload = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] allowed_direct_url_schemes = [] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] api_rate_limit = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] auth_strategy = keystone {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] az_cache_duration = 3600 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_availability_zone = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_host = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_name = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_stats_polling_interval = 60 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backup_api_class = cinder.backup.api.API {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backup_name_template = backup-%s {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backup_use_same_host = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backup_use_temp_snapshot = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] chap_password = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] chap_username = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cinder_internal_tenant_project_id = 1d38e5ded16441279899e0f5fcdfde96 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cinder_internal_tenant_user_id = 0d2026dfbc75426a80b1b212dadd1db9 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cloned_volume_same_az = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cluster = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:46 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] compression_format = gzip {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] compute_api_class = cinder.compute.nova.API {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] config_dir = [] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] config_source = [] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76317]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] control_exchange = openstack {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] debug = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] default_availability_zone = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] default_group_type = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] default_volume_type = lvmdriver-1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] disk_geometry = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] driver_client_cert = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] driver_client_cert_key = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] driver_data_namespace = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] driver_ssl_cert_path = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] driver_ssl_cert_verify = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] driver_use_ssl = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] enable_force_upload = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] enable_new_services = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] enable_unsupported_driver = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] enforce_multipath_for_image_xfer = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] filter_function = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance_api_insecure = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance_api_ssl_compression = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance_ca_certificates_file = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance_catalog_info = image:glance:publicURL {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance_certfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance_keyfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance_num_retries = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance_request_timeout = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] goodness_function = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] graceful_shutdown_timeout = 5 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] group_api_class = cinder.group.api.API {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] host = devstack {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] image_compress_on_upload = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] image_conversion_address_space_limit = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] image_conversion_cpu_limit = 60 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] image_conversion_disable = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] image_upload_use_cinder_backend = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] image_upload_use_internal_tenant = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] image_volume_cache_enabled = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] image_volume_cache_max_count = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] image_volume_cache_max_size_gb = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] init_host_max_objects_retrieval = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] instance_format = [instance: %(uuid)s] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] iscsi_target_flags = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] iscsi_write_cache = on {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] iser_helper = tgtadm {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] iser_ip_address = 192.168.122.20 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack sudo[76321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] iser_port = 3260 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] log_color = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] log_config_append = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] log_dir = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] log_file = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] log_options = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] log_rotate_interval = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] log_rotate_interval_type = days {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] log_rotation_type = none {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack sudo[76321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] max_age = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] max_logfile_count = 30 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] max_logfile_size_mb = 200 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] max_over_subscription_ratio = 20.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] message_reap_interval = 86400 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] message_ttl = 2592000 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] migration_create_volume_timeout_secs = 300 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] monkey_patch = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] monkey_patch_modules = [] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] my_ip = 192.168.122.20 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] no_snapshot_gb_quota = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] num_iser_scan_tries = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] num_shell_tries = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] num_volume_device_scan_tries = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] nvmeof_conn_info_version = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] nvmet_ns_id = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] nvmet_port_id = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] osapi_max_limit = 1000 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] osapi_volume_ext_list = [] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] osapi_volume_listen_port = 8776 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] osapi_volume_use_ssl = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] osapi_volume_workers = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] per_volume_size_limit = -1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] periodic_fuzzy_delay = 60 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] periodic_interval = 60 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] public_endpoint = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] publish_errors = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] quota_backup_gigabytes = 1000 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] quota_backups = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] quota_gigabytes = 1000 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] quota_groups = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] quota_snapshots = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] quota_volumes = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] rate_limit_burst = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] rate_limit_except_level = CRITICAL {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] rate_limit_interval = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] reinit_driver_count = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] replication_device = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] report_discard_supported = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] report_interval = 120 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] reservation_clean_interval = 86400 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] reservation_expire = 86400 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] reserved_image_namespaces = [] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] reserved_percentage = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] rpc_response_timeout = 120 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] run_external_periodic_tasks = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] scst_target_driver = iscsi {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] scst_target_iqn_name = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_down_time = 720 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] shell_completion = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] snapshot_name_template = snapshot-%s {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] snapshot_same_host = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] split_loggers = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] state_path = /opt/stack/data/cinder {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] storage_availability_zone = nova {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] storage_protocol = iSCSI {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] syslog_log_facility = LOG_USER {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] target_helper = lioadm {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] target_ip_address = 192.168.122.20 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] target_port = 3260 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] target_protocol = iscsi {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] target_secondary_ip_addresses = [] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] trace_flags = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] transport_url = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] until_refresh = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] use_chap_auth = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] use_default_quota_class = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] use_journal = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] use_json = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] use_multipath_for_image_xfer = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] use_stderr = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] use_syslog = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] verify_glance_signatures = enabled {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_api_class = cinder.volume.api.API {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_backend_name = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_clear = zero {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_clear_ionice = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_clear_size = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_copy_bps_limit = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_dd_blocksize = 1M {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_name_template = volume-%s {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_service_inithost_offload = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volume_usage_audit_period = month {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] zoning_mode = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_concurrency.disable_process_locking = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.auth_section = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.auth_type = password {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.auth_version = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.cache = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.certfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.include_service_catalog = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.insecure = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.interface = public {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.keyfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_password = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcache_username = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.region_name = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.service_type = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.backend = dogpile.cache.null {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.backend_argument = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.backend_expiration_time = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.config_prefix = cache.oslo {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.debug_cache_backend = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.enable_retry_client = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76317]: INFO cinder.volume.manager [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.enable_socket_keepalive = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.enabled = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.expiration_time = 600 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.hashclient_retry_attempts = 2 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.memcache_dead_retry = 300 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.memcache_pool_maxsize = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.memcache_sasl_enabled = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.password = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.proxies = [] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.redis_db = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.redis_server = localhost:6379 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.retry_attempts = 2 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.retry_delay = 0.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.socket_keepalive_count = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.socket_keepalive_idle = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.socket_keepalive_interval = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.socket_timeout = 1.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.tls_allowed_ciphers = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.tls_cafile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.tls_certfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.tls_enabled = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.tls_keyfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cache.username = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] coordination.backend_url = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.asyncio_connection = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.asyncio_slave_connection = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.backend = sqlalchemy {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.connection = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.connection_debug = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.connection_parameters = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.connection_recycle_time = 3600 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.connection_trace = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.db_inc_retry_interval = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.db_max_retries = 20 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.db_max_retry_interval = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.db_retry_interval = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.max_overflow = 50 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.max_pool_size = 5 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.max_retries = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.mysql_wsrep_sync_wait = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.pool_timeout = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.retry_interval = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.slave_connection = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.sqlite_synchronous = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.synchronous_reader = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] database.use_db_reconnect = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.connection_string = messaging:// {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.enabled = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.es_doc_type = notification {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.es_scroll_size = 10000 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.es_scroll_time = 2m {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.filter_error_trace = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.hmac_keys = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.sentinel_service_name = mymaster {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.socket_timeout = 0.1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.trace_requests = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler.trace_sqlalchemy = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler_jaeger.process_tags = {} {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler_jaeger.service_name_prefix = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] profiler_otlp.service_name_prefix = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.enforce_new_defaults = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.enforce_scope = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.policy_default_rule = default {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.policy_file = policy.yaml {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] privsep_osbrick.group = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] privsep_osbrick.helper_command = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] privsep_osbrick.user = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cinder_sys_admin.group = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cinder_sys_admin.helper_command = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] cinder_sys_admin.user = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_user.auth_section = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_user.auth_type = password {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_user.cafile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_user.certfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_user.collect_timing = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_user.insecure = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_user.keyfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_user.send_service_user_token = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_user.split_loggers = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] service_user.timeout = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance.auth_section = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance.auth_type = password {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance.certfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance.collect_timing = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance.insecure = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance.keyfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance.region_name = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance.split_loggers = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] glance.timeout = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.backend_availability_zone = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.chap_password = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.chap_username = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.disk_geometry = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.driver_client_cert = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.driver_client_cert_key = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.driver_data_namespace = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.driver_use_ssl = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.extra_capabilities = {} {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.filter_function = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.goodness_function = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.iscsi_target_flags = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.iscsi_write_cache = on {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.iser_helper = tgtadm {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.iser_port = 3260 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.lvm_share_target = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.lvm_type = auto {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.num_shell_tries = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.replication_device = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.report_discard_supported = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.reserved_percentage = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.target_helper = tgtadm {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.target_port = 3260 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.target_protocol = iscsi {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.trace_flags = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.unique_fqdn_network = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.use_chap_auth = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.volume_backend_name = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.volume_clear = zero {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.volume_clear_ionice = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.volume_clear_size = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_reports.file_event_handler = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_reports.log_dir = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.backend_host = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.chap_password = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.chap_username = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.disk_geometry = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.driver_client_cert = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.extra_capabilities = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.filter_function = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.goodness_function = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.iser_helper = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.iser_ip_address = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.iser_port = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.lvm_share_target = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.lvm_type = auto {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.num_shell_tries = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.replication_device = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.report_discard_supported = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.reserved_percentage = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.scst_target_driver = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.storage_protocol = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.target_helper = lioadm {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.target_ip_address = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.target_port = 3260 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.trace_flags = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.use_chap_auth = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.volume_clear = zero {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.volume_clear_size = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] lvmdriver-1.volumes_dir = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.ssl = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_notifications.driver = [] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_notifications.retry = -1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] key_manager.fixed_key = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.barbican_api_version = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.barbican_endpoint = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.barbican_endpoint_type = public {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.barbican_region_name = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.cafile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.certfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.collect_timing = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.insecure = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.keyfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.number_of_retries = 60 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.retry_delay = 1 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.send_service_user_token = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.split_loggers = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.timeout = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.verify_ssl = True {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican.verify_ssl_path = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican_service_user.auth_section = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican_service_user.auth_type = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican_service_user.cafile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican_service_user.certfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican_service_user.collect_timing = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican_service_user.insecure = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican_service_user.keyfile = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican_service_user.split_loggers = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] barbican_service_user.timeout = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.approle_role_id = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.approle_secret_id = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.auth_method = approle {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.auth_path = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.kv_mountpoint = secret {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.kv_path = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.kv_version = 2 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.namespace = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.root_token_id = **** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.ssl_ca_crt_file = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.timeout = 60.0 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.token_file = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.token_role = None {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.use_ssl = False {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:32:47 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] ******************************************************************************** {{(pid=76108) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 18:32:47 devstack sudo[76321]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:47 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.734s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:47 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:47 devstack sudo[76367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:32:47 devstack sudo[76367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:48 devstack sudo[76367]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:48 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.683s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:48 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:32:48 devstack cinder-volume[76317]: INFO cinder.brick.local_dev.lvm [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 11 18:32:48 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:48 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:48 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:48 devstack sudo[76628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:32:48 devstack sudo[76628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:49 devstack sudo[76628]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:49 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:49 devstack cinder-volume[76317]: DEBUG cinder.brick.local_dev.lvm [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76317) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 11 18:32:49 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:49 devstack sudo[76838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:32:49 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:50 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:50 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.433s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:50 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:50 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:50 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:50 devstack sudo[77069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:32:50 devstack sudo[77069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:51 devstack sudo[77069]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:51 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.779s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:51 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:51 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:51 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:51 devstack sudo[77102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 11 18:32:51 devstack sudo[77102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:52 devstack sudo[77102]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:52 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.722s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:52 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:52 devstack sudo[77113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:32:52 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:53 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:53 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.806s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:53 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:53 devstack sudo[77118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:32:53 devstack sudo[77118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:53 devstack sudo[77118]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:53 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.928s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:53 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:54 devstack sudo[77124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:32:54 devstack sudo[77124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:54 devstack sudo[77124]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:54 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.942s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:54 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:54 devstack sudo[77129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:32:54 devstack sudo[77129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:55 devstack sudo[77129]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:55 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.737s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:55 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:55 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:55 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:55 devstack sudo[77142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:32:55 devstack sudo[77142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:56 devstack sudo[77142]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:56 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.839s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:56 devstack cinder-volume[76317]: INFO cinder.volume.drivers.lvm [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 11 18:32:56 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:56 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:56 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:56 devstack sudo[77261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:32:56 devstack sudo[77261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:56 devstack cinder-volume[76108]: DEBUG dbcounter [-] [76108] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76108) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:32:57 devstack sudo[77261]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:57 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.665s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:57 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 18:32:57 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:57 devstack sudo[77403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:32:57 devstack sudo[77403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:57 devstack sudo[77403]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:57 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:57 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:57 devstack sudo[77406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:32:57 devstack sudo[77406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:58 devstack sudo[77406]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:58 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:58 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:58 devstack sudo[77409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:32:58 devstack sudo[77409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:59 devstack sudo[77409]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:59 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:59 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:32:59 devstack sudo[77413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:32:59 devstack sudo[77413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:32:59 devstack sudo[77413]: pam_unix(sudo:session): session closed for user root Jul 11 18:32:59 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:32:59 devstack cinder-volume[76317]: INFO cinder.volume.driver [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 18:32:59 devstack cinder-volume[76317]: DEBUG cinder.volume.driver [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76317) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 18:32:59 devstack cinder-volume[76317]: DEBUG oslo_db.sqlalchemy.engines [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76317) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:32:59 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writer thread running {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:32:59 devstack cinder-volume[76317]: DEBUG cinder.db.api [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Building query based on filter {{(pid=76317) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 18:32:59 devstack cinder-volume[76317]: DEBUG cinder.image.image_utils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76317) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 18:32:59 devstack cinder-volume[76317]: INFO cinder.keymgr.migration [None req-93f9fc87-c321-4646-954a-2473c4efe2ea None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 18:32:59 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 18:32:59 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:33:00 devstack sudo[77420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:33:00 devstack sudo[77420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:33:00 devstack sudo[77420]: pam_unix(sudo:session): session closed for user root Jul 11 18:33:00 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:33:00 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:33:00 devstack sudo[77424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:33:00 devstack sudo[77424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:33:01 devstack sudo[77424]: pam_unix(sudo:session): session closed for user root Jul 11 18:33:01 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:33:01 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:33:01 devstack sudo[77428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:33:01 devstack sudo[77428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:33:02 devstack sudo[77428]: pam_unix(sudo:session): session closed for user root Jul 11 18:33:02 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.722s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:33:02 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:33:02 devstack sudo[77431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:33:02 devstack sudo[77431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:33:02 devstack sudo[77431]: pam_unix(sudo:session): session closed for user root Jul 11 18:33:02 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:33:02 devstack cinder-volume[76317]: DEBUG cinder.manager [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Notifying Schedulers of capabilities ... {{(pid=76317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:33:02 devstack cinder-volume[76317]: INFO cinder.volume.manager [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Driver initialization completed successfully. Jul 11 18:33:02 devstack cinder-volume[76317]: INFO cinder.manager [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Initiating service 2 cleanup Jul 11 18:33:02 devstack cinder-volume[76317]: INFO cinder.manager [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Service 2 cleanup completed. Jul 11 18:33:02 devstack cinder-volume[76317]: DEBUG cinder.service [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Creating RPC server for service cinder-volume {{(pid=76317) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 18:33:02 devstack cinder-volume[76317]: DEBUG cinder.service [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76317) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 18:33:02 devstack cinder-volume[76317]: INFO cinder.volume.manager [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 11 18:33:02 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 18:33:02 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:33:02 devstack sudo[77438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:33:02 devstack sudo[77438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:33:03 devstack sudo[77438]: pam_unix(sudo:session): session closed for user root Jul 11 18:33:03 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:33:03 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:33:03 devstack sudo[77495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:33:03 devstack sudo[77495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:33:04 devstack sudo[77495]: pam_unix(sudo:session): session closed for user root Jul 11 18:33:04 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:33:04 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:33:04 devstack sudo[77498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:33:04 devstack sudo[77498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:33:04 devstack sudo[77498]: pam_unix(sudo:session): session closed for user root Jul 11 18:33:04 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:33:04 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:33:04 devstack sudo[77501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:33:04 devstack sudo[77501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:33:05 devstack sudo[77501]: pam_unix(sudo:session): session closed for user root Jul 11 18:33:05 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:33:05 devstack cinder-volume[76317]: INFO cinder.volume.manager [None req-a70f36e0-2f9d-4bfc-a54d-7fd0cc5c0211 None None] Driver post RPC initialization completed successfully. Jul 11 18:33:15 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:33:15 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:33:23 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running periodic task VolumeManager._thread_info {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:33:23 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] thread count: 6 {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:33:23 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] thread info: [<_MainThread(MainThread, started 128376090714240)>, , , , , ] {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:34:23 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:34:23 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 18:34:23 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:23 devstack sudo[79822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:34:23 devstack sudo[79822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:24 devstack sudo[79822]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:24 devstack sudo[79826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:34:24 devstack sudo[79826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:24 devstack sudo[79826]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:24 devstack sudo[79830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:34:24 devstack sudo[79830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:25 devstack sudo[79830]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:25 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:25 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:34:25 devstack sudo[79836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:34:25 devstack sudo[79836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:34:26 devstack sudo[79836]: pam_unix(sudo:session): session closed for user root Jul 11 18:34:26 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:34:26 devstack cinder-volume[76317]: DEBUG cinder.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Notifying Schedulers of capabilities ... {{(pid=76317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:34:26 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running periodic task VolumeManager._thread_info {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:34:26 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] thread count: 6 {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:34:26 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] thread info: [<_MainThread(MainThread, started 128376090714240)>, , , , , ] {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:35:15 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writing DB stats cinder:SELECT=1 {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:35:15 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writing DB stats cinder:UPDATE=1 {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:35:23 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:35:23 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 18:35:23 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:35:23 devstack sudo[83444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:35:23 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:35:24 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root Jul 11 18:35:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:35:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:35:24 devstack sudo[83491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:35:24 devstack sudo[83491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:35:24 devstack sudo[83491]: pam_unix(sudo:session): session closed for user root Jul 11 18:35:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:35:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:35:24 devstack sudo[83547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:35:24 devstack sudo[83547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:35:25 devstack sudo[83547]: pam_unix(sudo:session): session closed for user root Jul 11 18:35:25 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.680s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:35:25 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:35:25 devstack sudo[83561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:35:25 devstack sudo[83561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:35:26 devstack sudo[83561]: pam_unix(sudo:session): session closed for user root Jul 11 18:35:26 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:35:26 devstack cinder-volume[76317]: DEBUG cinder.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Notifying Schedulers of capabilities ... {{(pid=76317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:35:26 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running periodic task VolumeManager._thread_info {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:35:26 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] thread count: 6 {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:35:26 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] thread info: [<_MainThread(MainThread, started 128376090714240)>, , , , , ] {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:36:23 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:36:23 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 18:36:23 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:36:23 devstack sudo[85124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:36:23 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:36:24 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root Jul 11 18:36:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:36:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:36:24 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:36:24 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:36:24 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Jul 11 18:36:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:36:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:36:24 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:36:24 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:36:25 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Jul 11 18:36:25 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.630s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:36:25 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:36:25 devstack sudo[85181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:36:25 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:36:26 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root Jul 11 18:36:26 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:36:26 devstack cinder-volume[76317]: DEBUG cinder.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Notifying Schedulers of capabilities ... {{(pid=76317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:36:26 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running periodic task VolumeManager._thread_info {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:36:26 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] thread count: 6 {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:36:26 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] thread info: [<_MainThread(MainThread, started 128376090714240)>, , , , , ] {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:37:15 devstack cinder-volume[76317]: DEBUG dbcounter [-] [76317] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76317) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:37:23 devstack cinder-volume[76108]: INFO oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Caught SIGTERM, stopping children Jul 11 18:37:23 devstack cinder-volume[76108]: DEBUG oslo_concurrency.lockutils [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Acquiring lock "singleton_lock" {{(pid=76108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:37:23 devstack cinder-volume[76108]: DEBUG oslo_concurrency.lockutils [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Acquired lock "singleton_lock" {{(pid=76108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:37:23 devstack cinder-volume[76108]: DEBUG oslo_concurrency.lockutils [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Releasing lock "singleton_lock" {{(pid=76108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:37:23 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Stop services. {{(pid=76108) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 11 18:37:23 devstack cinder-volume[76108]: DEBUG oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Killing children. {{(pid=76108) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 11 18:37:23 devstack cinder-volume[76108]: INFO oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Waiting on 1 children to exit Jul 11 18:37:23 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:37:23 devstack cinder-volume[76317]: DEBUG cinder.volume.drivers.lvm [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Updating volume stats {{(pid=76317) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 18:37:23 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:23 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 18:37:23 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:24 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:24 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:37:24 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:24 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:24 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:24 devstack sudo[86406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 18:37:24 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:25 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:25 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.664s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:25 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:25 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 18:37:25 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:26 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:26 devstack cinder-volume[76317]: DEBUG oslo_concurrency.processutils [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76317) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:26 devstack cinder-volume[76317]: DEBUG cinder.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Notifying Schedulers of capabilities ... {{(pid=76317) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:37:26 devstack cinder-volume[76317]: DEBUG oslo_service.periodic_task [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] Running periodic task VolumeManager._thread_info {{(pid=76317) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:37:26 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] thread count: 6 {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:37:26 devstack cinder-volume[76317]: DEBUG cinder.volume.manager [None req-f2c38fda-e343-4a54-a072-967a9ffa1033 None None] thread info: [<_MainThread(MainThread, started 128376090714240)>, , , , , ] {{(pid=76317) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:37:27 devstack cinder-volume[76317]: DEBUG oslo_concurrency.lockutils [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Acquiring lock "singleton_lock" {{(pid=76317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:37:27 devstack cinder-volume[76317]: DEBUG oslo_concurrency.lockutils [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Acquired lock "singleton_lock" {{(pid=76317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:37:27 devstack cinder-volume[76317]: DEBUG oslo_concurrency.lockutils [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Releasing lock "singleton_lock" {{(pid=76317) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:37:27 devstack cinder-volume[76317]: WARNING amqp [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 18:37:27 devstack cinder-volume[76317]: WARNING amqp [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 18:37:27 devstack cinder-volume[76108]: INFO oslo_service.backend._eventlet.service [None req-0b43867d-0d14-4c31-bdd6-35e79e158f44 None None] Child 76317 exited with status 0 Jul 11 18:37:28 devstack cinder-volume[86416]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 18:37:28 devstack cinder-volume[86416]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 18:37:28 devstack cinder-volume[86416]: we strongly recommend against using it for new projects. Jul 11 18:37:28 devstack cinder-volume[86416]: If you are already using Eventlet, we recommend migrating to a different Jul 11 18:37:28 devstack cinder-volume[86416]: framework. For more detail see Jul 11 18:37:28 devstack cinder-volume[86416]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 18:37:28 devstack cinder-volume[86416]: import eventlet # noqa Jul 11 18:37:30 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86416) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:37:30 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86416) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:37:30 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86416) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:37:31 devstack cinder-volume[86416]: INFO dbcounter [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Registered counter for database cinder Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_db.sqlalchemy.engines [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86416) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG dbcounter [-] [86416] Writer thread running {{(pid=86416) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:37:31 devstack cinder-volume[86416]: INFO cinder.rpc [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 18:37:31 devstack cinder-volume[86416]: INFO cinder.rpc [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_db.sqlalchemy.engines [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86416) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:37:31 devstack cinder-volume[86416]: INFO cinder.volume.manager [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Determined volume DB was empty at startup. Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG cinder.volume.manager [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86416) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 18:37:31 devstack cinder-volume[86416]: INFO cinder.volume.manager [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 11 18:37:31 devstack cinder-volume[86416]: WARNING stevedore.named [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 18:37:31 devstack cinder-volume[86416]: WARNING castellan.key_manager [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:37:31 devstack cinder-volume[86416]: WARNING cinder.keymgr.conf_key_mgr [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:37:31 devstack cinder-volume[86416]: INFO cinder.volume.manager [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_db.sqlalchemy.engines [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86416) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:37:31 devstack cinder-volume[86416]: INFO oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Starting 1 workers Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Started child 86632 {{(pid=86416) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Full set of CONF: {{(pid=86416) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] ******************************************************************************** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Configuration options gathered from: {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] ================================================================================ {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] allow_availability_zone_fallback = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] allow_compression_on_image_upload = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] allowed_direct_url_schemes = [] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] api_rate_limit = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] auth_strategy = keystone {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_availability_zone = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86632]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_host = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_name = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_stats_polling_interval = 60 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backup_api_class = cinder.backup.api.API {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backup_name_template = backup-%s {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backup_use_same_host = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backup_use_temp_snapshot = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] chap_password = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] chap_username = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cinder_internal_tenant_project_id = 1d38e5ded16441279899e0f5fcdfde96 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cinder_internal_tenant_user_id = 0d2026dfbc75426a80b1b212dadd1db9 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cluster = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] compression_format = gzip {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] compute_api_class = cinder.compute.nova.API {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] config_dir = [] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] config_source = [] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] control_exchange = openstack {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] debug = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] default_availability_zone = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] default_group_type = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] default_volume_type = QuobyteHD {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] disk_geometry = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] driver_client_cert = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] driver_client_cert_key = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] driver_data_namespace = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] driver_ssl_cert_path = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] driver_ssl_cert_verify = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] driver_use_ssl = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] enable_new_services = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] enable_unsupported_driver = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] enabled_backends = ['QuobyteHD'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] enforce_multipath_for_image_xfer = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] filter_function = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance_api_insecure = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance_api_ssl_compression = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance_ca_certificates_file = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance_catalog_info = image:glance:publicURL {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance_certfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance_keyfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance_num_retries = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance_request_timeout = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] goodness_function = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] graceful_shutdown_timeout = 5 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] group_api_class = cinder.group.api.API {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] host = devstack {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] image_compress_on_upload = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] image_conversion_address_space_limit = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] image_conversion_cpu_limit = 60 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] image_conversion_disable = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] image_upload_use_cinder_backend = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] image_upload_use_internal_tenant = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] image_volume_cache_enabled = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] image_volume_cache_max_count = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] image_volume_cache_max_size_gb = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] init_host_max_objects_retrieval = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] instance_format = [instance: %(uuid)s] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] iscsi_target_flags = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] iscsi_write_cache = on {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] iser_helper = tgtadm {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] iser_ip_address = 192.168.122.20 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] iser_port = 3260 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] log_color = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] log_config_append = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] log_dir = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] log_file = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] log_options = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] log_rotate_interval = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] log_rotate_interval_type = days {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] log_rotation_type = none {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] max_age = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] max_logfile_count = 30 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86632]: INFO cinder.volume.manager [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Starting volume driver QuobyteDriver (1.1.14) Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] max_logfile_size_mb = 200 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] max_over_subscription_ratio = 20.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] message_reap_interval = 86400 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86632]: DEBUG cinder.volume.drivers.remotefs [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86632) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] message_ttl = 2592000 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] migration_create_volume_timeout_secs = 300 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] monkey_patch = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] monkey_patch_modules = [] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] my_ip = 192.168.122.20 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] no_snapshot_gb_quota = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] num_iser_scan_tries = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] num_shell_tries = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] num_volume_device_scan_tries = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] nvmeof_conn_info_version = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] nvmet_ns_id = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] nvmet_port_id = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] osapi_max_limit = 1000 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] osapi_volume_ext_list = [] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] osapi_volume_listen_port = 8776 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] osapi_volume_use_ssl = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] osapi_volume_workers = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] per_volume_size_limit = -1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] periodic_fuzzy_delay = 60 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] periodic_interval = 60 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] public_endpoint = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] publish_errors = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] quota_backup_gigabytes = 1000 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] quota_backups = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] quota_gigabytes = 1000 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] quota_groups = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] quota_snapshots = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] quota_volumes = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] rate_limit_burst = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] rate_limit_except_level = CRITICAL {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] rate_limit_interval = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] reinit_driver_count = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] replication_device = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] report_discard_supported = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] report_interval = 120 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] reservation_clean_interval = 86400 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] reservation_expire = 86400 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] reserved_image_namespaces = [] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] reserved_percentage = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] rpc_response_timeout = 120 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] run_external_periodic_tasks = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] scst_target_driver = iscsi {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] scst_target_iqn_name = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_down_time = 720 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] shell_completion = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] snapshot_name_template = snapshot-%s {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] split_loggers = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] state_path = /opt/stack/data/cinder {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] storage_availability_zone = nova {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] storage_protocol = iSCSI {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] syslog_log_facility = LOG_USER {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] target_helper = lioadm {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] target_ip_address = 192.168.122.20 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] target_port = 3260 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] target_protocol = iscsi {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] target_secondary_ip_addresses = [] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] trace_flags = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] transport_url = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] until_refresh = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] use_chap_auth = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] use_default_quota_class = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] use_journal = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] use_json = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] use_multipath_for_image_xfer = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] use_stderr = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] use_syslog = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] verify_glance_signatures = enabled {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_api_class = cinder.volume.api.API {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_backend_name = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_clear = zero {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_clear_ionice = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_clear_size = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_copy_bps_limit = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_dd_blocksize = 1M {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_name_template = volume-%s {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_service_inithost_offload = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volume_usage_audit_period = month {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] zoning_mode = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_concurrency.disable_process_locking = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.auth_section = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.auth_type = password {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.auth_version = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.cache = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.certfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.include_service_catalog = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.insecure = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.interface = public {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.keyfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_password = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcache_username = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.region_name = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.service_type = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86632]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86632) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 11 18:37:31 devstack cinder-volume[86632]: WARNING cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 11 18:37:31 devstack cinder-volume[86632]: WARNING cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.backend = dogpile.cache.null {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.backend_argument = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Running cmd (subprocess): mount.quobyte {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.backend_expiration_time = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.config_prefix = cache.oslo {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.debug_cache_backend = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.enable_retry_client = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.enable_socket_keepalive = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.enabled = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.expiration_time = 600 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.hashclient_retry_attempts = 2 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.memcache_dead_retry = 300 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.memcache_pool_maxsize = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.memcache_sasl_enabled = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.password = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.proxies = [] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.redis_db = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.redis_server = localhost:6379 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.retry_attempts = 2 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.retry_delay = 0.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.socket_keepalive_count = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.socket_keepalive_idle = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.socket_keepalive_interval = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.socket_timeout = 1.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.tls_allowed_ciphers = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.tls_cafile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.tls_certfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.tls_enabled = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.tls_keyfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cache.username = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] coordination.backend_url = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.asyncio_connection = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.asyncio_slave_connection = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.backend = sqlalchemy {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.connection = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.connection_debug = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.connection_parameters = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.connection_recycle_time = 3600 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.connection_trace = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.db_inc_retry_interval = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.db_max_retries = 20 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.db_max_retry_interval = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.db_retry_interval = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.max_overflow = 50 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.max_pool_size = 5 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.max_retries = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.mysql_wsrep_sync_wait = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.pool_timeout = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.retry_interval = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.slave_connection = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.sqlite_synchronous = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.synchronous_reader = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] database.use_db_reconnect = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.connection_string = messaging:// {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.enabled = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.es_doc_type = notification {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.es_scroll_size = 10000 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:31 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.es_scroll_time = 2m {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.filter_error_trace = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.hmac_keys = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.sentinel_service_name = mymaster {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.socket_timeout = 0.1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.trace_requests = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler.trace_sqlalchemy = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler_jaeger.process_tags = {} {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler_jaeger.service_name_prefix = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] profiler_otlp.service_name_prefix = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.enforce_new_defaults = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.enforce_scope = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.policy_default_rule = default {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.policy_file = policy.yaml {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] privsep_osbrick.group = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] privsep_osbrick.helper_command = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] privsep_osbrick.user = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cinder_sys_admin.group = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cinder_sys_admin.helper_command = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] cinder_sys_admin.user = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_user.auth_section = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_user.auth_type = password {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_user.cafile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_user.certfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_user.collect_timing = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_user.insecure = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_user.keyfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_user.send_service_user_token = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_user.split_loggers = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] service_user.timeout = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance.auth_section = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance.auth_type = password {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance.certfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance.collect_timing = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance.insecure = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance.keyfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance.region_name = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance.split_loggers = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] glance.timeout = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.backend_availability_zone = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.chap_password = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.chap_username = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.disk_geometry = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.driver_client_cert = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.driver_client_cert_key = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.driver_data_namespace = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] CMD "mount.quobyte" returned: 1 in 0.110s {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.driver_use_ssl = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.extra_capabilities = {} {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.filter_function = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.goodness_function = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.iscsi_target_flags = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.iscsi_write_cache = on {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.iser_helper = tgtadm {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:37:32 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:37:32 devstack cinder-volume[86632]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=86632) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:37:32 devstack cinder-volume[86632]: INFO cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e ... Jul 11 18:37:32 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd -c /etc/quobyte/client-cinder.cfg {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.iser_port = 3260 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nas_host = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nas_login = admin {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nas_mount_options = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nas_password = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nas_private_key = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nas_share_path = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.num_shell_tries = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.quobyte_volume_url = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.replication_device = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.report_discard_supported = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.reserved_percentage = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.target_helper = tgtadm {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.target_port = 3260 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.target_protocol = iscsi {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.trace_flags = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.unique_fqdn_network = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.use_chap_auth = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.volume_backend_name = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.volume_clear = zero {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.volume_clear_ionice = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.volume_clear_size = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_reports.file_event_handler = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd -c /etc/quobyte/client-cinder.cfg Jul 11 18:37:32 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_reports.log_dir = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.backend_availability_zone = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.backend_host = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.chap_password = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.chap_username = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.chiscsi_conf = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.disk_geometry = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.driver_client_cert = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.driver_data_namespace = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.driver_use_ssl = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.extra_capabilities = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.filter_function = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.goodness_function = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.iser_helper = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.iser_ip_address = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.iser_port = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.iser_target_prefix = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nas_host = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nas_login = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nas_mount_options = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nas_password = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nas_private_key = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nas_share_path = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nas_ssh_port = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.num_shell_tries = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.nvmet_port_id = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.replication_device = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.report_discard_supported = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.reserved_percentage = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.scst_target_driver = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.storage_protocol = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.target_helper = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.target_ip_address = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.target_port = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.target_prefix = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.target_protocol = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.trace_flags = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.use_chap_auth = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.volume_clear = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.volume_clear_size = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] QuobyteHD.volumes_dir = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.ssl = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_notifications.driver = [] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_notifications.retry = -1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] key_manager.fixed_key = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.barbican_api_version = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.barbican_endpoint = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.barbican_endpoint_type = public {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.barbican_region_name = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.cafile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.certfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.collect_timing = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.insecure = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.keyfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.number_of_retries = 60 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.retry_delay = 1 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.send_service_user_token = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.split_loggers = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.timeout = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.verify_ssl = True {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican.verify_ssl_path = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican_service_user.auth_section = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican_service_user.auth_type = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican_service_user.cafile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican_service_user.certfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican_service_user.collect_timing = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican_service_user.insecure = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican_service_user.keyfile = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican_service_user.split_loggers = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] barbican_service_user.timeout = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.approle_role_id = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.approle_secret_id = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.auth_method = approle {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.auth_path = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.kv_mountpoint = secret {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.kv_path = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.kv_version = 2 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.namespace = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.root_token_id = **** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.ssl_ca_crt_file = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.timeout = 60.0 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.token_file = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.token_role = None {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.use_ssl = False {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:32 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] ******************************************************************************** {{(pid=86416) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 18:37:32 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:32 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.783s {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:32 devstack cinder-volume[86632]: INFO cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e succeeded Jul 11 18:37:32 devstack cinder-volume[86632]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=86632) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:37:32 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.795s {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:37:32 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:32 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:37:32 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:33 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.645s {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:33 devstack cinder-volume[86632]: INFO cinder.volume.driver [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Driver hasn't implemented _init_vendor_properties() Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG cinder.volume.driver [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86632) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG oslo_db.sqlalchemy.engines [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86632) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG dbcounter [-] [86632] Writer thread running {{(pid=86632) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG cinder.db.api [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Building query based on filter {{(pid=86632) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG cinder.image.image_utils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86632) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 18:37:33 devstack cinder-volume[86632]: INFO cinder.keymgr.migration [None req-fc03aa13-d9e2-47fa-b620-e3e7120c4d98 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=86632) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=86632) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:37:33 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:33 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:37:33 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:34 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:34 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.673s {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:34 devstack cinder-volume[86632]: DEBUG cinder.manager [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Notifying Schedulers of capabilities ... {{(pid=86632) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:37:34 devstack cinder-volume[86632]: INFO cinder.volume.manager [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Driver initialization completed successfully. Jul 11 18:37:34 devstack cinder-volume[86632]: INFO cinder.manager [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Initiating service 3 cleanup Jul 11 18:37:34 devstack cinder-volume[86632]: INFO cinder.manager [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Service 3 cleanup completed. Jul 11 18:37:34 devstack cinder-volume[86632]: DEBUG cinder.service [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Creating RPC server for service cinder-volume {{(pid=86632) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 18:37:34 devstack cinder-volume[86632]: DEBUG cinder.service [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86632) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 18:37:34 devstack cinder-volume[86632]: INFO cinder.volume.manager [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 11 18:37:34 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:37:34 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:37:34 devstack cinder-volume[86632]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=86632) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:37:34 devstack cinder-volume[86632]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=86632) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:37:34 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:37:34 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:34 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:37:34 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:35 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:35 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.824s {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:35 devstack cinder-volume[86632]: INFO cinder.volume.manager [None req-ce7ba974-1e17-4a5b-96d4-270a1596a0be None None] Driver post RPC initialization completed successfully. Jul 11 18:37:39 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-d711831b-d60d-443d-8a26-5c37749f8eae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:37:39 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-d711831b-d60d-443d-8a26-5c37749f8eae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:37:39 devstack cinder-volume[86632]: DEBUG cinder.volume.drivers.quobyte [None req-d711831b-d60d-443d-8a26-5c37749f8eae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=86632) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:37:39 devstack cinder-volume[86632]: DEBUG cinder.volume.drivers.quobyte [None req-d711831b-d60d-443d-8a26-5c37749f8eae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=86632) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:37:39 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-d711831b-d60d-443d-8a26-5c37749f8eae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86632) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:37:39 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-d711831b-d60d-443d-8a26-5c37749f8eae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:39 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:37:39 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:40 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:40 devstack cinder-volume[86632]: DEBUG oslo_concurrency.processutils [None req-d711831b-d60d-443d-8a26-5c37749f8eae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.614s {{(pid=86632) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:40 devstack cinder-volume[86632]: DEBUG cinder.manager [None req-d711831b-d60d-443d-8a26-5c37749f8eae None None] Notifying Schedulers of capabilities ... {{(pid=86632) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:37:41 devstack cinder-volume[86416]: INFO oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Caught SIGTERM, stopping children Jul 11 18:37:41 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Acquiring lock "singleton_lock" {{(pid=86416) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:37:41 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Acquired lock "singleton_lock" {{(pid=86416) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:37:41 devstack cinder-volume[86416]: DEBUG oslo_concurrency.lockutils [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Releasing lock "singleton_lock" {{(pid=86416) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:37:41 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Stop services. {{(pid=86416) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 11 18:37:41 devstack cinder-volume[86416]: DEBUG oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Killing children. {{(pid=86416) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 11 18:37:41 devstack cinder-volume[86416]: INFO oslo_service.backend._eventlet.service [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Waiting on 1 children to exit Jul 11 18:37:44 devstack cinder-volume[86632]: DEBUG dbcounter [-] [86632] Writing DB stats cinder:SELECT=4 {{(pid=86632) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:37:45 devstack cinder-volume[86632]: DEBUG dbcounter [-] [86632] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86632) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:37:46 devstack cinder-volume[86632]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 11 18:37:47 devstack cinder-volume[87155]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 18:37:47 devstack cinder-volume[87155]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 18:37:47 devstack cinder-volume[87155]: we strongly recommend against using it for new projects. Jul 11 18:37:47 devstack cinder-volume[87155]: If you are already using Eventlet, we recommend migrating to a different Jul 11 18:37:47 devstack cinder-volume[87155]: framework. For more detail see Jul 11 18:37:47 devstack cinder-volume[87155]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 18:37:47 devstack cinder-volume[87155]: import eventlet # noqa Jul 11 18:37:47 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Acquiring lock "singleton_lock" {{(pid=86632) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:37:47 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Acquired lock "singleton_lock" {{(pid=86632) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:37:47 devstack cinder-volume[86632]: DEBUG oslo_concurrency.lockutils [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Releasing lock "singleton_lock" {{(pid=86632) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:37:47 devstack cinder-volume[86632]: WARNING amqp [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 18:37:47 devstack cinder-volume[86632]: WARNING amqp [None req-fd8e79f4-3bc1-4202-b314-c52cab6fc93b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 18:37:49 devstack cinder-volume[87155]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87155) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 18:37:49 devstack cinder-volume[87155]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87155) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 18:37:49 devstack cinder-volume[87155]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87155) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 18:37:50 devstack cinder-volume[87155]: INFO dbcounter [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Registered counter for database cinder Jul 11 18:37:50 devstack cinder-volume[87155]: DEBUG oslo_db.sqlalchemy.engines [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87155) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:37:50 devstack cinder-volume[87155]: DEBUG dbcounter [-] [87155] Writer thread running {{(pid=87155) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:37:50 devstack cinder-volume[87155]: INFO cinder.rpc [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 18:37:50 devstack cinder-volume[87155]: INFO cinder.rpc [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 18:37:50 devstack cinder-volume[87155]: DEBUG oslo_db.sqlalchemy.engines [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87155) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:37:50 devstack cinder-volume[87155]: INFO cinder.volume.manager [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Determined volume DB was empty at startup. Jul 11 18:37:50 devstack cinder-volume[87155]: DEBUG cinder.volume.manager [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87155) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 18:37:50 devstack cinder-volume[87155]: WARNING stevedore.named [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 18:37:50 devstack cinder-volume[87155]: WARNING castellan.key_manager [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:37:50 devstack cinder-volume[87155]: WARNING cinder.keymgr.conf_key_mgr [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 18:37:50 devstack cinder-volume[87155]: INFO cinder.volume.manager [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_db.sqlalchemy.engines [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87155) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:37:51 devstack cinder-volume[87155]: INFO oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Starting 1 workers Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Started child 87411 {{(pid=87155) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Full set of CONF: {{(pid=87155) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] ******************************************************************************** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] Configuration options gathered from: {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] ================================================================================ {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] allow_availability_zone_fallback = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] allow_compression_on_image_upload = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] allowed_direct_url_schemes = [] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] api_rate_limit = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] auth_strategy = keystone {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_availability_zone = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87411]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_host = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_name = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_stats_polling_interval = 60 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backup_api_class = cinder.backup.api.API {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backup_name_template = backup-%s {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backup_use_same_host = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backup_use_temp_snapshot = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] chap_password = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] chap_username = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cinder_internal_tenant_project_id = 1d38e5ded16441279899e0f5fcdfde96 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cinder_internal_tenant_user_id = 0d2026dfbc75426a80b1b212dadd1db9 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cluster = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] compression_format = gzip {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] compute_api_class = cinder.compute.nova.API {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] config_dir = [] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] config_source = [] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] control_exchange = openstack {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] debug = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] default_availability_zone = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] default_group_type = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] default_volume_type = QuobyteHD {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] disk_geometry = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] driver_client_cert = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] driver_client_cert_key = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] driver_data_namespace = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] driver_ssl_cert_path = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] driver_ssl_cert_verify = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] driver_use_ssl = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] enable_new_services = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] enable_unsupported_driver = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] enabled_backends = ['QuobyteHD'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] enforce_multipath_for_image_xfer = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] filter_function = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance_api_insecure = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance_api_ssl_compression = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance_ca_certificates_file = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance_catalog_info = image:glance:publicURL {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance_certfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance_keyfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance_num_retries = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance_request_timeout = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] goodness_function = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] graceful_shutdown_timeout = 5 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] group_api_class = cinder.group.api.API {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] host = devstack {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] image_compress_on_upload = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] image_conversion_address_space_limit = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] image_conversion_cpu_limit = 60 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] image_conversion_disable = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] image_upload_use_cinder_backend = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] image_upload_use_internal_tenant = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] image_volume_cache_enabled = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] image_volume_cache_max_count = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] image_volume_cache_max_size_gb = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] init_host_max_objects_retrieval = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] instance_format = [instance: %(uuid)s] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] iscsi_target_flags = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] iscsi_write_cache = on {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] iser_helper = tgtadm {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] iser_ip_address = 192.168.122.20 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] iser_port = 3260 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] log_color = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] log_config_append = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] log_dir = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] log_file = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] log_options = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] log_rotate_interval = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] log_rotate_interval_type = days {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] log_rotation_type = none {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] max_age = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] max_logfile_count = 30 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] max_logfile_size_mb = 200 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] max_over_subscription_ratio = 20.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] message_reap_interval = 86400 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] message_ttl = 2592000 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] migration_create_volume_timeout_secs = 300 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] monkey_patch = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] monkey_patch_modules = [] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] my_ip = 192.168.122.20 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] no_snapshot_gb_quota = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] num_iser_scan_tries = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] num_shell_tries = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] num_volume_device_scan_tries = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] nvmeof_conn_info_version = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] nvmet_ns_id = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87411) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] nvmet_port_id = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] osapi_max_limit = 1000 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] osapi_volume_ext_list = [] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] osapi_volume_listen = 0.0.0.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] osapi_volume_listen_port = 8776 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] osapi_volume_use_ssl = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] osapi_volume_workers = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] per_volume_size_limit = -1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] periodic_fuzzy_delay = 60 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] periodic_interval = 60 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] project_id_regex = [0-9a-f\-]+ {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] public_endpoint = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] publish_errors = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] quota_backup_gigabytes = 1000 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] quota_backups = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] quota_gigabytes = 1000 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] quota_groups = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] quota_snapshots = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] quota_volumes = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] rate_limit_burst = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] rate_limit_except_level = CRITICAL {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] rate_limit_interval = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] reinit_driver_count = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] replication_device = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] report_discard_supported = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] report_interval = 120 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] reservation_clean_interval = 86400 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] reservation_expire = 86400 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] reserved_image_namespaces = [] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] reserved_percentage = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] rpc_response_timeout = 120 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] run_external_periodic_tasks = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] scst_target_driver = iscsi {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] scst_target_iqn_name = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_down_time = 720 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] shell_completion = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] snapshot_name_template = snapshot-%s {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] split_loggers = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] state_path = /opt/stack/data/cinder {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] storage_availability_zone = nova {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] storage_protocol = iSCSI {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] syslog_log_facility = LOG_USER {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] target_helper = lioadm {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] target_ip_address = 192.168.122.20 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] target_port = 3260 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] target_protocol = iscsi {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] target_secondary_ip_addresses = [] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] trace_flags = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] transfer_api_class = cinder.transfer.api.API {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] transport_url = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] until_refresh = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] use_chap_auth = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] use_default_quota_class = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] use_journal = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] use_json = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] use_multipath_for_image_xfer = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] use_stderr = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] use_syslog = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] verify_glance_signatures = enabled {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_api_class = cinder.volume.api.API {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_backend_name = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_clear = zero {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_clear_ionice = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_clear_size = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_copy_bps_limit = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_dd_blocksize = 1M {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_name_template = volume-%s {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_service_inithost_offload = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volume_usage_audit_period = month {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] zoning_mode = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_concurrency.disable_process_locking = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.auth_section = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.auth_type = password {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.auth_version = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.cache = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.certfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.delay_auth_decision = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.http_connect_timeout = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.include_service_catalog = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.insecure = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.interface = public {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.keyfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_password = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcache_username = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.region_name = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.service_token_roles_required = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.service_type = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.token_cache_time = 300 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.backend = dogpile.cache.null {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.backend_argument = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.backend_expiration_time = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.config_prefix = cache.oslo {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.debug_cache_backend = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.enable_retry_client = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.enable_socket_keepalive = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.enabled = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.expiration_time = 600 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.hashclient_retry_attempts = 2 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.memcache_dead_retry = 300 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87411) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.memcache_pool_maxsize = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.memcache_sasl_enabled = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.password = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.proxies = [] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.redis_db = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.quobyte [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.redis_sentinel_service_name = mymaster {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.redis_server = localhost:6379 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.retry_attempts = 2 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.quobyte [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.retry_delay = 0.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.socket_keepalive_count = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.socket_keepalive_idle = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.socket_keepalive_interval = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Running cmd (subprocess): mount.quobyte {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.socket_timeout = 1.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.tls_allowed_ciphers = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.tls_cafile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.tls_certfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.tls_enabled = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.tls_keyfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cache.username = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] coordination.backend_url = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.asyncio_connection = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.asyncio_slave_connection = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.backend = sqlalchemy {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.connection = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.connection_debug = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.connection_parameters = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.connection_recycle_time = 3600 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.connection_trace = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.db_inc_retry_interval = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.db_max_retries = 20 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.db_max_retry_interval = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.db_retry_interval = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.max_overflow = 50 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.max_pool_size = 5 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.max_retries = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.mysql_wsrep_sync_wait = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.pool_timeout = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.retry_interval = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.slave_connection = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.sqlite_synchronous = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.synchronous_reader = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] database.use_db_reconnect = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.connection_string = messaging:// {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.enabled = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.es_doc_type = notification {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.es_scroll_size = 10000 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.es_scroll_time = 2m {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.filter_error_trace = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.hmac_keys = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.sentinel_service_name = mymaster {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.socket_timeout = 0.1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.trace_requests = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler.trace_sqlalchemy = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler_jaeger.process_tags = {} {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler_jaeger.service_name_prefix = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] profiler_otlp.service_name_prefix = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.enforce_new_defaults = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.enforce_scope = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.policy_default_rule = default {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.policy_file = policy.yaml {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_policy.remote_timeout = 60.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] privsep_osbrick.group = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] privsep_osbrick.helper_command = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] privsep_osbrick.user = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cinder_sys_admin.group = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cinder_sys_admin.helper_command = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] cinder_sys_admin.user = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_user.auth_section = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_user.auth_type = password {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_user.cafile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_user.certfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_user.collect_timing = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_user.insecure = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_user.keyfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_user.send_service_user_token = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_user.split_loggers = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] service_user.timeout = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance.auth_section = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance.auth_type = password {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance.certfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance.collect_timing = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance.insecure = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance.keyfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance.region_name = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance.split_loggers = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] glance.timeout = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.backend_availability_zone = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.chap_password = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.chap_username = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.disk_geometry = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.driver_client_cert = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.driver_client_cert_key = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.driver_data_namespace = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.driver_use_ssl = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.enable_unsupported_driver = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.extra_capabilities = {} {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.filter_function = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.goodness_function = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.iscsi_target_flags = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.iscsi_write_cache = on {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.iser_helper = tgtadm {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.iser_port = 3260 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nas_host = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nas_login = admin {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nas_mount_options = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nas_password = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nas_private_key = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack quobyte-client[87412]: Reading configuration file: /etc/quobyte/client.cfg Jul 11 18:37:51 devstack quobyte-client[87412]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nas_share_path = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nas_ssh_port = 22 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.num_shell_tries = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.nvmet_port_id = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.quobyte_client_cfg = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.quobyte_volume_url = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.replication_device = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.report_discard_supported = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.reserved_percentage = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.scst_target_driver = iscsi {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.scst_target_iqn_name = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.storage_protocol = iSCSI {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.target_helper = tgtadm {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.target_port = 3260 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.target_protocol = iscsi {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.trace_flags = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.unique_fqdn_network = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.use_chap_auth = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.volume_backend_name = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.volume_clear = zero {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.volume_clear_ionice = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.volume_clear_size = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_reports.file_event_handler = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_reports.log_dir = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.backend_availability_zone = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.backend_host = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.chap_password = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.chap_username = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.chiscsi_conf = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.disk_geometry = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.driver_client_cert = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.driver_client_cert_key = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.driver_data_namespace = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.driver_use_ssl = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.extra_capabilities = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.filter_function = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.goodness_function = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.iscsi_target_flags = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.iscsi_write_cache = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.iser_helper = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.iser_ip_address = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.iser_port = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.iser_target_prefix = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nas_host = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nas_login = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nas_mount_options = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nas_password = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nas_private_key = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nas_share_path = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nas_ssh_port = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.num_shell_tries = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nvmet_ns_id = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.nvmet_port_id = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.replication_device = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.report_discard_supported = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.reserved_percentage = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.scst_target_driver = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.storage_protocol = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.target_helper = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.target_ip_address = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.target_port = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.target_prefix = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.target_protocol = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.trace_flags = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.unique_fqdn_network = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.use_chap_auth = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.volume_clear = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.volume_clear_ionice = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.volume_clear_size = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] QuobyteHD.volumes_dir = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.ssl = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.ssl_version = {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_notifications.driver = [] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_notifications.retry = -1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] oslo_messaging_notifications.transport_url = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] key_manager.fixed_key = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.barbican_api_version = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.barbican_endpoint = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.barbican_endpoint_type = public {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.barbican_region_name = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.cafile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.certfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.collect_timing = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.insecure = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.keyfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.number_of_retries = 60 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.retry_delay = 1 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.send_service_user_token = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.split_loggers = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.timeout = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.verify_ssl = True {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican.verify_ssl_path = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican_service_user.auth_section = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican_service_user.auth_type = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican_service_user.cafile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican_service_user.certfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican_service_user.collect_timing = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican_service_user.insecure = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican_service_user.keyfile = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican_service_user.split_loggers = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] barbican_service_user.timeout = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.approle_role_id = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.approle_secret_id = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.auth_method = approle {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.auth_path = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.kv_mountpoint = secret {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.kv_path = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.kv_version = 2 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.namespace = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.root_token_id = **** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.ssl_ca_crt_file = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.timeout = 60.0 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.token_file = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.token_role = None {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.use_ssl = False {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 18:37:51 devstack cinder-volume[87155]: DEBUG oslo_service.backend._eventlet.service [None req-dacbc449-9a7a-4616-bc95-75192392b03d None None] ******************************************************************************** {{(pid=87155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 18:37:51 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.621s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:51 devstack cinder-volume[87411]: INFO cinder.volume.driver [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG cinder.volume.driver [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87411) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG oslo_db.sqlalchemy.engines [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 18:37:51 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writer thread running {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG cinder.db.api [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Building query based on filter {{(pid=87411) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87411) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:52 devstack cinder-volume[87411]: INFO cinder.keymgr.migration [None req-1dcf2f24-aac0-452e-8cea-d6e5c9a151dc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 18:37:52 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:37:52 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:52 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.607s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:37:52 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Driver initialization completed successfully. Jul 11 18:37:52 devstack cinder-volume[87411]: INFO cinder.manager [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Initiating service 3 cleanup Jul 11 18:37:52 devstack cinder-volume[87411]: INFO cinder.manager [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Service 3 cleanup completed. Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG cinder.service [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Creating RPC server for service cinder-volume {{(pid=87411) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG cinder.service [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87411) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 18:37:52 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:37:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:37:52 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:37:52 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:37:53 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Jul 11 18:37:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.613s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:37:53 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e055c96d-4c73-4526-bede-c26cff4a2bf8 None None] Driver post RPC initialization completed successfully. Jul 11 18:38:01 devstack cinder-volume[87155]: DEBUG dbcounter [-] [87155] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87155) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:38:02 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:38:03 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=3 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Flow 'volume_create_manager' (f81bfd16-c989-48e8-b19f-712a16e3e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b74f1e-501a-40d9-ad24-47b3c8697d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b74f1e-501a-40d9-ad24-47b3c8697d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1756988416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea3f4f4-071b-453c-aa57-e48fefdb0bed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94caeb0bebba47d1bc806f13a8cc3add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:38:50Z,use_quota=True,user_id='3fa23e2e76b64be9a31a3b0bb58a3336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a952742b-44d8-4e21-a67a-e316b8b63fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a952742b-44d8-4e21-a67a-e316b8b63fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d9ab4d-ab37-4d0b-ba9a-b831619fcb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d9ab4d-ab37-4d0b-ba9a-b831619fcb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ea3f4f4-071b-453c-aa57-e48fefdb0bed', 'volume_name': 'volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac2b7c0-6343-4102-b273-3939b2d8d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac2b7c0-6343-4102-b273-3939b2d8d678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a2b79c-ebd6-4e07-8b60-ad5599e9221a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:38:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Volume 2ea3f4f4-071b-453c-aa57-e48fefdb0bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed', 'volume_size': 1} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1756988416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea3f4f4-071b-453c-aa57-e48fefdb0bed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='94caeb0bebba47d1bc806f13a8cc3add',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:38:50Z,use_quota=True,user_id='3fa23e2e76b64be9a31a3b0bb58a3336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Creating volume 2ea3f4f4-071b-453c-aa57-e48fefdb0bed {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:38:50 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:38:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:50 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed 1073741824 Jul 11 18:38:50 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:38:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:38:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:38:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:38:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:38:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:38:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:51 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:38:51 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:53 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.690s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:53 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:38:53 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:38:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 6 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:38:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:38:54 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed 1073741824" returned: 0 in 3.189s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:38:54 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed Jul 11 18:38:54 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:55 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Jul 11 18:38:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed" returned: 0 in 1.308s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:38:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] <== create_volume: return (4641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:38:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.653s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:38:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a2b79c-ebd6-4e07-8b60-ad5599e9221a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:38:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfefc1c8-0acc-4b13-adc2-a7025fd08912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:38:55 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Volume volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed (2ea3f4f4-071b-453c-aa57-e48fefdb0bed): created successfully Jul 11 18:38:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfefc1c8-0acc-4b13-adc2-a7025fd08912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:38:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Flow 'volume_create_manager' (f81bfd16-c989-48e8-b19f-712a16e3e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:38:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-f63b2872-900f-4a2a-b1b8-186398320bb5 req-e0e532b5-fbf9-4666-8b52-ec0f8501ff39 tempest-VolumesGetTestJSON-1105475601 None] Created volume successfully. Jul 11 18:38:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Acquiring lock "cinder-2ea3f4f4-071b-453c-aa57-e48fefdb0bed-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:38:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Lock "cinder-2ea3f4f4-071b-453c-aa57-e48fefdb0bed-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:38:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Acquiring lock "cinder-quobyte-2ea3f4f4-071b-453c-aa57-e48fefdb0bed" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:38:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Lock "cinder-quobyte-2ea3f4f4-071b-453c-aa57-e48fefdb0bed" acquired by "delete_volume" :: waited 0.036s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:38:56 devstack cinder-volume[87411]: INFO oslo.privsep.daemon [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptx1lbzm1/privsep.sock'] Jul 11 18:38:56 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptx1lbzm1/privsep.sock Jul 11 18:38:56 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:38:58 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 11 18:38:58 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 18:38:58 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 11 18:38:58 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 18:38:58 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 11 18:38:58 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 11 18:38:58 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 18:38:58 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 18:38:58 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 11 18:38:59 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 11 18:38:59 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 18:38:59 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 11 18:38:59 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 18:38:59 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 11 18:38:59 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 11 18:38:59 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 18:38:59 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 18:38:59 devstack cinder-volume[87411]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 11 18:38:59 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:00 devstack cinder-volume[87411]: INFO oslo.privsep.daemon [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Spawned new privsep daemon via rootwrap Jul 11 18:39:00 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Accepted privsep connection to /tmp/tmptx1lbzm1/privsep.sock {{(pid=87411) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 11 18:39:00 devstack cinder-volume[87411]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 11 18:39:00 devstack cinder-volume[87411]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 11 18:39:00 devstack cinder-volume[87411]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 11 18:39:00 devstack cinder-volume[87411]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88221 Jul 11 18:39:00 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bf5d49-dca3-4764-80a3-21038050aa10]: (2,) {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:39:00 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[32006814-cec5-4b2e-a706-169d1fd336ab]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:39:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:00 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed Jul 11 18:39:00 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:01 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed" returned: 0 in 1.351s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:01 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed Jul 11 18:39:01 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:02 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ea3f4f4-071b-453c-aa57-e48fefdb0bed" returned: 0 in 1.121s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Lock "cinder-quobyte-2ea3f4f4-071b-453c-aa57-e48fefdb0bed" released by "delete_volume" :: held 5.882s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:39:02 devstack cinder-volume[87411]: WARNING cinder.quota [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:39:02 devstack cinder-volume[87411]: WARNING cinder.quota [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:39:02 devstack cinder-volume[87411]: DEBUG cinder.quota [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Created reservations ['12de9760-5126-4bd2-8a00-ff97e7b3a2ac', '12b35f59-97f4-455e-93ef-29f8d23ced6c', '4283b47c-8bad-4deb-ba54-e502f6e4f230', '85ab5642-9262-42d2-9ed0-16429f860127'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:39:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:02 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:39:02 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:03 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.923s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:03 devstack cinder-volume[87411]: DEBUG cinder.manager [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:39:03 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Deleted volume successfully. Jul 11 18:39:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-df3ea329-f684-40aa-bd50-1f86088cdccb req-02b23995-ad6f-49a0-a050-5a1ad8df3c38 tempest-VolumesGetTestJSON-1105475601 None] Lock "cinder-2ea3f4f4-071b-453c-aa57-e48fefdb0bed-delete_volume" released by "delete_volume" :: held 7.311s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:39:08 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-73b97ebe-070a-4fc9-be44-d1b724eb9085 tempest-GroupSnapshotsV319Test-826663691 None] Group tempest-GroupSnapshotsV319Test-Group-1365765781: creating Jul 11 18:39:08 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-73b97ebe-070a-4fc9-be44-d1b724eb9085 tempest-GroupSnapshotsV319Test-826663691 None] Group tempest-GroupSnapshotsV319Test-Group-1365765781: created successfully Jul 11 18:39:08 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-73b97ebe-070a-4fc9-be44-d1b724eb9085 tempest-GroupSnapshotsV319Test-826663691 None] Create group completed successfully. Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Flow 'volume_create_manager' (b58146b2-b3e5-448d-991e-d14c20463f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2e9652-26a3-45d9-9363-918264a0ea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2e9652-26a3-45d9-9363-918264a0ea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-546256812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b2b0cac-ff53-4a20-9635-ca7d0bdd45d9,host='devstack@QuobyteHD#QuobyteHD',id=61518dc0-9a10-4536-8c30-38a062be150a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60805de08f1c434c931888c4ef8f7cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:39:11Z,use_quota=True,user_id='53301750a5ed42d5aa3b23438fb38a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f445c32c-6406-4858-9a6b-83ccf5394c8c),volume_type_id=f445c32c-6406-4858-9a6b-83ccf5394c8c)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e57b4ff-3194-4129-9cbd-0b541ebcb12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e57b4ff-3194-4129-9cbd-0b541ebcb12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691abc74-8e6b-497d-bba1-4444d64bda6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691abc74-8e6b-497d-bba1-4444d64bda6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61518dc0-9a10-4536-8c30-38a062be150a', 'volume_name': 'volume-61518dc0-9a10-4536-8c30-38a062be150a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d729445f-cf16-4dba-b0a1-1f575c1fd34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d729445f-cf16-4dba-b0a1-1f575c1fd34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceae89dd-fced-4c3b-88da-1615e07d138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:11 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Volume 61518dc0-9a10-4536-8c30-38a062be150a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61518dc0-9a10-4536-8c30-38a062be150a', 'volume_size': 1} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3b2b0cac-ff53-4a20-9635-ca7d0bdd45d9,created_at=2026-07-11T16:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-546256812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b2b0cac-ff53-4a20-9635-ca7d0bdd45d9,host='devstack@QuobyteHD#QuobyteHD',id=61518dc0-9a10-4536-8c30-38a062be150a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60805de08f1c434c931888c4ef8f7cf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:39:11Z,use_quota=True,user_id='53301750a5ed42d5aa3b23438fb38a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f445c32c-6406-4858-9a6b-83ccf5394c8c),volume_type_id=f445c32c-6406-4858-9a6b-83ccf5394c8c)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Creating volume 61518dc0-9a10-4536-8c30-38a062be150a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:39:11 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:39:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:11 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a 1073741824 Jul 11 18:39:11 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:12 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a 1073741824" returned: 0 in 1.559s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:13 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a Jul 11 18:39:13 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:13 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a" returned: 0 in 0.974s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] <== create_volume: return (2604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:39:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.610s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceae89dd-fced-4c3b-88da-1615e07d138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61518dc0-9a10-4536-8c30-38a062be150a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def358a3-a812-458e-a087-d7eff6a02cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:14 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Volume volume-61518dc0-9a10-4536-8c30-38a062be150a (61518dc0-9a10-4536-8c30-38a062be150a): created successfully Jul 11 18:39:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def358a3-a812-458e-a087-d7eff6a02cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Flow 'volume_create_manager' (b58146b2-b3e5-448d-991e-d14c20463f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:39:14 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-cb717eb8-a967-40a1-a069-25b3c015424c tempest-GroupSnapshotsV319Test-826663691 None] Created volume successfully. Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Flow 'volume_create_manager' (9a1f42c8-d359-4940-a351-975e6de8e0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5128941-15e0-49fd-8629-a7e3512640ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5128941-15e0-49fd-8629-a7e3512640ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-31311918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39af210f-fb70-496c-9af5-2d8fe6aa1a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6354e245b93244bb844721cf18581d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:39:15Z,use_quota=True,user_id='975dfaaefcbe49ed8151ac9d4cf3ed87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2798b07-75bf-48ba-9a68-c15abd99471f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2798b07-75bf-48ba-9a68-c15abd99471f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7118e96-a704-4a24-84ae-4a25c9a1c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7118e96-a704-4a24-84ae-4a25c9a1c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39af210f-fb70-496c-9af5-2d8fe6aa1a58', 'volume_name': 'volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee2501c-3d18-4caa-8ca3-fc79c0808259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee2501c-3d18-4caa-8ca3-fc79c0808259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e6006-bf6d-4996-bab1-9d3830db17f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Volume 39af210f-fb70-496c-9af5-2d8fe6aa1a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58', 'volume_size': 1} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-31311918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39af210f-fb70-496c-9af5-2d8fe6aa1a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6354e245b93244bb844721cf18581d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:39:15Z,use_quota=True,user_id='975dfaaefcbe49ed8151ac9d4cf3ed87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Creating volume 39af210f-fb70-496c-9af5-2d8fe6aa1a58 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:39:15 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:39:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:15 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58 1073741824 Jul 11 18:39:15 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:16 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] GroupSnapshot 2daabd2a-acf4-47d9-a146-e454bfdee07d: creating. Jul 11 18:39:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Group snapshot 2daabd2a-acf4-47d9-a146-e454bfdee07d: creating. {{(pid=87411) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:39:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:16 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58 1073741824" returned: 0 in 1.214s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:16 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58 Jul 11 18:39:16 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:17 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58" returned: 0 in 0.926s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.501s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e6006-bf6d-4996-bab1-9d3830db17f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32da8fe2-74b5-4f59-bd68-c732cb953f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Creating offline snapshot 14c06882-3a87-425d-84f3-91eecb09f36c of volume 61518dc0-9a10-4536-8c30-38a062be150a {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:39:17 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Volume volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58 (39af210f-fb70-496c-9af5-2d8fe6aa1a58): created successfully Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32da8fe2-74b5-4f59-bd68-c732cb953f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Flow 'volume_create_manager' (9a1f42c8-d359-4940-a351-975e6de8e0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[128af769-f65a-4630-8023-5dd5b59b067b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:39:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b366c11c-e3ce-485d-9491-260b13842c0f tempest-ServerRescueNegativeTestJSON-1334294004 None] Created volume successfully. Jul 11 18:39:17 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a Jul 11 18:39:17 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:19 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a" returned: 0 in 1.761s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:19 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c 1G Jul 11 18:39:19 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:20 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c 1G" returned: 0 in 1.280s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61518dc0-9a10-4536-8c30-38a062be150a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:20 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61518dc0-9a10-4536-8c30-38a062be150a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c Jul 11 18:39:20 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:22 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61518dc0-9a10-4536-8c30-38a062be150a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c" returned: 0 in 1.695s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:22 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:39:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:22 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c Jul 11 18:39:22 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:24 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c" returned: 0 in 1.975s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:24 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.info Jul 11 18:39:24 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:25 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.info" returned: 0 in 0.989s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:25 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:39:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:25 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.info Jul 11 18:39:25 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Flow 'volume_create_manager' (355e4900-9329-4342-a994-d8d39dcfa912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:39:26 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbae106-5d71-4046-8057-1e5b2e7bdf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.info" returned: 0 in 1.128s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.138s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbae106-5d71-4046-8057-1e5b2e7bdf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-54884550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebad8fe-f315-49b6-a210-3a0985816531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0855ec4912546249e969e2d7257ca51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:39:27Z,use_quota=True,user_id='2368a673e1aa49b19e138e754e72bc3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed2ec83-66ad-444c-ab2a-497498d577ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed2ec83-66ad-444c-ab2a-497498d577ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22c415a-ddac-47a5-91e9-1c2b24d8b439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22c415a-ddac-47a5-91e9-1c2b24d8b439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebad8fe-f315-49b6-a210-3a0985816531', 'volume_name': 'volume-2ebad8fe-f315-49b6-a210-3a0985816531', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f37491e-e233-489d-bd70-4a7ef7379928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f37491e-e233-489d-bd70-4a7ef7379928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0847689-7b5c-4e42-9002-a78b27de8d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:26 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Volume 2ebad8fe-f315-49b6-a210-3a0985816531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebad8fe-f315-49b6-a210-3a0985816531', 'volume_size': 1} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-54884550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebad8fe-f315-49b6-a210-3a0985816531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0855ec4912546249e969e2d7257ca51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:39:27Z,use_quota=True,user_id='2368a673e1aa49b19e138e754e72bc3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Creating volume 2ebad8fe-f315-49b6-a210-3a0985816531 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:39:26 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:39:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:26 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531 1073741824 Jul 11 18:39:26 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:26 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-064ebc98-1b5c-4b8a-8799-020ffff16166 tempest-GroupSnapshotsV319Test-826663691 None] group_snapshot 2daabd2a-acf4-47d9-a146-e454bfdee07d: created successfully Jul 11 18:39:27 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] group_snapshot 2daabd2a-acf4-47d9-a146-e454bfdee07d: deleting Jul 11 18:39:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] group_snapshot 2daabd2a-acf4-47d9-a146-e454bfdee07d: deleting {{(pid=87411) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:39:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Acquiring lock "cinder-quobyte-61518dc0-9a10-4536-8c30-38a062be150a" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:39:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Lock "cinder-quobyte-61518dc0-9a10-4536-8c30-38a062be150a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:39:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Acquiring lock "cinder-quobyte-14c06882-3a87-425d-84f3-91eecb09f36c" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:39:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Lock "cinder-quobyte-14c06882-3a87-425d-84f3-91eecb09f36c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:39:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Deleting offline snapshot 14c06882-3a87-425d-84f3-91eecb09f36c of volume 61518dc0-9a10-4536-8c30-38a062be150a {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:39:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] snapshot_file for this snap is: volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:39:27 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abee731-af02-4b7d-bdae-06e340c7297b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:39:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:27 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c Jul 11 18:39:27 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:27 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531 1073741824" returned: 0 in 1.142s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:28 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531 Jul 11 18:39:28 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:29 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c" returned: 0 in 1.208s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61518dc0-9a10-4536-8c30-38a062be150a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:39:29 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531" returned: 0 in 1.006s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] <== create_volume: return (2218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[893c8c48-3680-4ccb-8f40-da943e7e638f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0847689-7b5c-4e42-9002-a78b27de8d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebad8fe-f315-49b6-a210-3a0985816531', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c39049-9628-4818-8ca8-7205ea31e5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:29 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Volume volume-2ebad8fe-f315-49b6-a210-3a0985816531 (2ebad8fe-f315-49b6-a210-3a0985816531): created successfully Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c39049-9628-4818-8ca8-7205ea31e5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Flow 'volume_create_manager' (355e4900-9329-4342-a994-d8d39dcfa912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:39:29 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b0f9420c-f3e9-4575-8ca9-fb1c2b96c1eb tempest-VolumesAdminNegativeTest-1566108849 None] Created volume successfully. Jul 11 18:39:29 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a Jul 11 18:39:29 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:29 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a" returned: 0 in 0.867s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:29 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c Jul 11 18:39:29 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Acquiring lock "cinder-2ebad8fe-f315-49b6-a210-3a0985816531-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:39:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Lock "cinder-2ebad8fe-f315-49b6-a210-3a0985816531-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:39:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Acquiring lock "cinder-quobyte-2ebad8fe-f315-49b6-a210-3a0985816531" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:39:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Lock "cinder-quobyte-2ebad8fe-f315-49b6-a210-3a0985816531" acquired by "delete_volume" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:39:30 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bee268-5be8-4ad5-b80a-161c9baaa244]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:39:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:30 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531 Jul 11 18:39:30 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c" returned: 0 in 0.899s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:30 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:30 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c Jul 11 18:39:30 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:31 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531" returned: 0 in 1.031s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:31 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531 Jul 11 18:39:31 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:31 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a.14c06882-3a87-425d-84f3-91eecb09f36c" returned: 0 in 0.808s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Lock "cinder-quobyte-14c06882-3a87-425d-84f3-91eecb09f36c" released by "_delete_snapshot" :: held 3.904s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:39:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Lock "cinder-quobyte-61518dc0-9a10-4536-8c30-38a062be150a" released by "delete_snapshot" :: held 3.938s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:39:31 devstack cinder-volume[87411]: WARNING cinder.quota [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1276123839 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1276123839, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:39:31 devstack cinder-volume[87411]: WARNING cinder.quota [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1276123839 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1276123839, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:39:31 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] Created reservations ['bd1123c1-7242-429d-b361-afad8d6b9ada', '3fa8a905-b0df-4e72-aa12-7790ad0460dc', '442d4113-a7d5-4ba2-bee9-0f3793c5cfb1', 'cfcad4d7-4caa-4934-9afd-538082c4f611'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:39:31 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9c351556-d8b2-4503-b61d-5bfd653804db tempest-GroupSnapshotsV319Test-826663691 None] group_snapshot 2daabd2a-acf4-47d9-a146-e454bfdee07d: deleted successfully Jul 11 18:39:32 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebad8fe-f315-49b6-a210-3a0985816531" returned: 0 in 0.960s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Lock "cinder-quobyte-2ebad8fe-f315-49b6-a210-3a0985816531" released by "delete_volume" :: held 2.034s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:39:32 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Created reservations ['d49c3635-75bb-4145-83b5-8102d815cf4e', 'a4ce990a-dc43-43c8-9c9e-d64894ba7781', 'b6b9ea32-975f-48c3-8e36-63bb8fdca71e', 'a4b4206f-0195-47b6-a829-700cd396e9a4'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:39:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:32 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:39:32 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Acquiring lock "cinder-quobyte-61518dc0-9a10-4536-8c30-38a062be150a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:39:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Lock "cinder-quobyte-61518dc0-9a10-4536-8c30-38a062be150a" acquired by "delete_volume" :: waited 0.065s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:39:33 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[66167aee-097e-46d5-a2c4-53bc6d7634dc]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:39:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:33 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a Jul 11 18:39:33 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:34 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.580s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:34 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:39:34 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Deleted volume successfully. Jul 11 18:39:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2b842da8-212e-4c1f-9427-3a3626087123 tempest-VolumesAdminNegativeTest-1566108849 None] Lock "cinder-2ebad8fe-f315-49b6-a210-3a0985816531-delete_volume" released by "delete_volume" :: held 3.983s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:39:34 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a" returned: 0 in 1.225s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:35 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a Jul 11 18:39:35 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:36 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-61518dc0-9a10-4536-8c30-38a062be150a" returned: 0 in 1.402s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Lock "cinder-quobyte-61518dc0-9a10-4536-8c30-38a062be150a" released by "delete_volume" :: held 2.816s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:39:36 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Created reservations ['a0cbbaf1-b5f5-4ef8-a5cc-786ab99eed21'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:39:36 devstack cinder-volume[87411]: WARNING cinder.quota [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1276123839 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1276123839, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:39:36 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Created reservations ['81404c5a-ba0f-4a13-a00d-fb97b699834f', '113a0d2c-fa97-440a-a83f-c8b292354d42', '39a159d2-9ee0-4d9c-b266-5b106d8ef33b', 'dcae8e40-a0df-4c3c-98e8-cb10b513390e'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:39:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:36 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:39:36 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:38 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.448s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:38 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:39:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-57f7b82e-dd32-4c5d-8cb3-6127047a5474 tempest-GroupSnapshotsV319Test-826663691 None] Delete group completed successfully. Jul 11 18:39:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Acquiring lock "cinder-39af210f-fb70-496c-9af5-2d8fe6aa1a58-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:39:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Lock "cinder-39af210f-fb70-496c-9af5-2d8fe6aa1a58-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:39:44 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=40,cinder:UPDATE=56,cinder:INSERT=5,cinder:DELETE=4 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:39:44 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=41,cinder:INSERT=17,cinder:DELETE=2,cinder:SELECT=42 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:39:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Acquiring lock "cinder-quobyte-39af210f-fb70-496c-9af5-2d8fe6aa1a58" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:39:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Lock "cinder-quobyte-39af210f-fb70-496c-9af5-2d8fe6aa1a58" acquired by "delete_volume" :: waited 0.048s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:39:45 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[554fdc6e-ed08-43e0-a0e6-b7b1101babb2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:39:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:45 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58 Jul 11 18:39:45 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:46 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58" returned: 0 in 1.556s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:46 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58 Jul 11 18:39:46 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:47 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-39af210f-fb70-496c-9af5-2d8fe6aa1a58" returned: 0 in 1.051s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Lock "cinder-quobyte-39af210f-fb70-496c-9af5-2d8fe6aa1a58" released by "delete_volume" :: held 2.719s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:39:47 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Created reservations ['3c3e01c2-34a5-40ff-b7ff-bbb800e66251', '4a4b5e03-4acc-42dc-b19c-ba34bc83a47b', 'aa8a2ea8-1301-453a-9536-15eddee6a095', '6138b539-f5ef-4f23-bb0e-8f1f073770d9'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:39:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:48 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:39:48 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:49 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.751s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:49 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:39:49 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Deleted volume successfully. Jul 11 18:39:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-970e681e-8e8b-4f74-8e02-24df7777ea4f tempest-ServerRescueNegativeTestJSON-1334294004 None] Lock "cinder-39af210f-fb70-496c-9af5-2d8fe6aa1a58-delete_volume" released by "delete_volume" :: held 5.089s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Flow 'volume_create_manager' (7a467bf3-a45a-49e5-a6c2-235e7e0a3647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f0483b-e7c6-424f-9b5f-0e6e1916fb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f0483b-e7c6-424f-9b5f-0e6e1916fb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-83659417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339d4287-a024-4513-8423-1082913deaa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f42a38d212349fe98dc4605cab32194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:39:50Z,use_quota=True,user_id='13242de5f3214f1f8c9333480eb303e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a78c188-4af5-4c7c-b6cc-f7914216a3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a78c188-4af5-4c7c-b6cc-f7914216a3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ed072c-ae0e-422e-a97e-417cf70e481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ed072c-ae0e-422e-a97e-417cf70e481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '339d4287-a024-4513-8423-1082913deaa9', 'volume_name': 'volume-339d4287-a024-4513-8423-1082913deaa9', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fef96c-8efd-4b80-9996-5e5a06401ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fef96c-8efd-4b80-9996-5e5a06401ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bce20a4-ebf7-42b9-821e-853cf263941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Volume 339d4287-a024-4513-8423-1082913deaa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-339d4287-a024-4513-8423-1082913deaa9', 'volume_size': 1} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-83659417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339d4287-a024-4513-8423-1082913deaa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f42a38d212349fe98dc4605cab32194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:39:50Z,use_quota=True,user_id='13242de5f3214f1f8c9333480eb303e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Creating volume 339d4287-a024-4513-8423-1082913deaa9 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:39:50 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:39:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:50 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 1073741824 Jul 11 18:39:50 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:39:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:39:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:39:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:39:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:39:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:51 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:39:51 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:53 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 1073741824" returned: 0 in 2.723s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:39:53 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 Jul 11 18:39:53 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:39:53 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 2.551s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:54 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:39:54 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:39:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 8 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:39:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:39:55 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Jul 11 18:39:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9" returned: 0 in 2.142s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:39:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] <== create_volume: return (4964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:39:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.970s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:39:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bce20a4-ebf7-42b9-821e-853cf263941c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339d4287-a024-4513-8423-1082913deaa9', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c101c5ac-4bbd-469d-aba7-5174a3988e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:39:55 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Volume volume-339d4287-a024-4513-8423-1082913deaa9 (339d4287-a024-4513-8423-1082913deaa9): created successfully Jul 11 18:39:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c101c5ac-4bbd-469d-aba7-5174a3988e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:39:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Flow 'volume_create_manager' (7a467bf3-a45a-49e5-a6c2-235e7e0a3647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:39:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-98b4d337-e9d3-405c-8999-8589e686cd54 tempest-DeleteServersTestJSON-245638939 None] Created volume successfully. Jul 11 18:40:02 devstack cinder-volume[87411]: WARNING py.warnings [req-658024a9-bfff-40c0-bb23-b53bd49ecdd2 req-b710a129-4bab-4150-976d-8dafe6f0427c tempest-DeleteServersTestJSON-245638939 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 11 18:40:02 devstack cinder-volume[87411]: .first() Jul 11 18:40:02 devstack cinder-volume[87411]: Jul 11 18:40:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-658024a9-bfff-40c0-bb23-b53bd49ecdd2 req-b710a129-4bab-4150-976d-8dafe6f0427c tempest-DeleteServersTestJSON-245638939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-658024a9-bfff-40c0-bb23-b53bd49ecdd2 req-b710a129-4bab-4150-976d-8dafe6f0427c tempest-DeleteServersTestJSON-245638939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:03 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2286f558-3080-4b43-ad38-cb794c2e8f0d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:40:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-658024a9-bfff-40c0-bb23-b53bd49ecdd2 req-b710a129-4bab-4150-976d-8dafe6f0427c tempest-DeleteServersTestJSON-245638939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:03 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 Jul 11 18:40:03 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:03 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-658024a9-bfff-40c0-bb23-b53bd49ecdd2 req-b710a129-4bab-4150-976d-8dafe6f0427c tempest-DeleteServersTestJSON-245638939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9" returned: 0 in 0.965s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-658024a9-bfff-40c0-bb23-b53bd49ecdd2 req-b710a129-4bab-4150-976d-8dafe6f0427c tempest-DeleteServersTestJSON-245638939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.998s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-658024a9-bfff-40c0-bb23-b53bd49ecdd2 req-b710a129-4bab-4150-976d-8dafe6f0427c tempest-DeleteServersTestJSON-245638939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-339d4287-a024-4513-8423-1082913deaa9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8789f84-7da7-4043-8f1d-e2f952af550c', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:40:04 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-658024a9-bfff-40c0-bb23-b53bd49ecdd2 req-b710a129-4bab-4150-976d-8dafe6f0427c tempest-DeleteServersTestJSON-245638939 None] attachment_update completed successfully. Jul 11 18:40:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-deff5324-bb6a-4f04-8a87-1dc43db071c3 tempest-GroupsTest-1863653854 None] Group tempest-Group1-1694237702: creating Jul 11 18:40:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-deff5324-bb6a-4f04-8a87-1dc43db071c3 tempest-GroupsTest-1863653854 None] Group tempest-Group1-1694237702: created successfully Jul 11 18:40:06 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-deff5324-bb6a-4f04-8a87-1dc43db071c3 tempest-GroupsTest-1863653854 None] Create group completed successfully. Jul 11 18:40:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d951048c-b079-4dd8-8b65-b19dce58563f tempest-GroupsTest-1863653854 None] Group tempest-Group2-176854082: creating Jul 11 18:40:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d951048c-b079-4dd8-8b65-b19dce58563f tempest-GroupsTest-1863653854 None] Group tempest-Group2-176854082: created successfully Jul 11 18:40:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d951048c-b079-4dd8-8b65-b19dce58563f tempest-GroupsTest-1863653854 None] Create group completed successfully. Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Flow 'volume_create_manager' (53daf3e0-9107-46cc-82c4-5a6dd5a3c30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba5cc0a-6d49-439e-902f-a71cabaf5eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba5cc0a-6d49-439e-902f-a71cabaf5eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1159758738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c1b4147-a5c1-41ac-a8b8-68f14f0c9173,host='devstack@QuobyteHD#QuobyteHD',id=be2913eb-fb65-48e9-9fde-e6b6c35c6a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893276e8f1474e49bffcb5cc2d99a0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:09Z,use_quota=True,user_id='4020726cff4d4b9b8bf502292304bd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(472440f5-b5cc-48f4-b16a-462f897c667b),volume_type_id=472440f5-b5cc-48f4-b16a-462f897c667b)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae0649b-55a7-4137-a7e9-52d255d86e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae0649b-55a7-4137-a7e9-52d255d86e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd534a1b-cc8c-4a16-9bb3-a6dbac3aff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd534a1b-cc8c-4a16-9bb3-a6dbac3aff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2913eb-fb65-48e9-9fde-e6b6c35c6a05', 'volume_name': 'volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b867630-0bdb-486c-9b2e-c11a280fcbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b867630-0bdb-486c-9b2e-c11a280fcbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07149006-2d66-4886-b05e-66aa5f209093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:09 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Volume be2913eb-fb65-48e9-9fde-e6b6c35c6a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05', 'volume_size': 1} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c1b4147-a5c1-41ac-a8b8-68f14f0c9173,created_at=2026-07-11T16:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1159758738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c1b4147-a5c1-41ac-a8b8-68f14f0c9173,host='devstack@QuobyteHD#QuobyteHD',id=be2913eb-fb65-48e9-9fde-e6b6c35c6a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893276e8f1474e49bffcb5cc2d99a0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:09Z,use_quota=True,user_id='4020726cff4d4b9b8bf502292304bd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(472440f5-b5cc-48f4-b16a-462f897c667b),volume_type_id=472440f5-b5cc-48f4-b16a-462f897c667b)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Creating volume be2913eb-fb65-48e9-9fde-e6b6c35c6a05 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:40:09 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:40:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:09 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05 1073741824 Jul 11 18:40:09 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:10 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05 1073741824" returned: 0 in 1.118s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:10 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05 Jul 11 18:40:10 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:11 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05" returned: 0 in 0.857s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:40:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07149006-2d66-4886-b05e-66aa5f209093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4027584-4ab9-419a-bac4-6fcc7150a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:11 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Volume volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05 (be2913eb-fb65-48e9-9fde-e6b6c35c6a05): created successfully Jul 11 18:40:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4027584-4ab9-419a-bac4-6fcc7150a239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Flow 'volume_create_manager' (53daf3e0-9107-46cc-82c4-5a6dd5a3c30a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:11 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fe2c8508-098d-4bed-9987-8b3c049a9c3c tempest-GroupsTest-1863653854 None] Created volume successfully. Jul 11 18:40:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Acquiring lock "cinder-quobyte-be2913eb-fb65-48e9-9fde-e6b6c35c6a05" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:40:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Lock "cinder-quobyte-be2913eb-fb65-48e9-9fde-e6b6c35c6a05" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:40:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd440d2b-cdeb-4c33-827c-421b5020a10b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:40:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:12 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05 Jul 11 18:40:12 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:13 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05" returned: 0 in 0.936s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:13 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05 Jul 11 18:40:13 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:14 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-794bdf69-ab83-4a17-87e1-a101eba7b928 req-da8f70ab-b857-4d31-830c-7364f459fc2e tempest-DeleteServersTestJSON-245638939 None] Terminate volume connection completed successfully. Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-794bdf69-ab83-4a17-87e1-a101eba7b928 req-da8f70ab-b857-4d31-830c-7364f459fc2e tempest-DeleteServersTestJSON-245638939 None] Deleting attachment e8789f84-7da7-4043-8f1d-e2f952af550c. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:40:14 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-be2913eb-fb65-48e9-9fde-e6b6c35c6a05" returned: 0 in 0.725s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Lock "cinder-quobyte-be2913eb-fb65-48e9-9fde-e6b6c35c6a05" released by "delete_volume" :: held 1.726s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Created reservations ['5de49f83-27d9-4088-92be-36d5ed691111'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:40:14 devstack cinder-volume[87411]: WARNING cinder.quota [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1082202250 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1082202250, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:40:14 devstack cinder-volume[87411]: WARNING cinder.quota [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1082202250 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1082202250, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Created reservations ['22c7eec1-f198-488f-80d8-b92cc8627c89', '845165d5-2659-48bd-8007-b83ba2b9a4ba', '3a4adbee-831e-4fb6-9fec-5953cc30123e', '7b26367b-351a-4768-80be-226271fd14b5'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:14 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:40:14 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:15 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.792s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:15 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:40:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d2a96b07-98fe-4b53-b35c-aa1cdae46e19 tempest-GroupsTest-1863653854 None] Delete group completed successfully. Jul 11 18:40:15 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-abc29d91-3da7-4e76-8659-77c01751b401 tempest-GroupsTest-1863653854 None] Created reservations ['6701e94f-162b-4fea-8465-eed2cceb08d5'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:40:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abc29d91-3da7-4e76-8659-77c01751b401 tempest-GroupsTest-1863653854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abc29d91-3da7-4e76-8659-77c01751b401 tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abc29d91-3da7-4e76-8659-77c01751b401 tempest-GroupsTest-1863653854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abc29d91-3da7-4e76-8659-77c01751b401 tempest-GroupsTest-1863653854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abc29d91-3da7-4e76-8659-77c01751b401 tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abc29d91-3da7-4e76-8659-77c01751b401 tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:15 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:40:15 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:16 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abc29d91-3da7-4e76-8659-77c01751b401 tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.761s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:16 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-abc29d91-3da7-4e76-8659-77c01751b401 tempest-GroupsTest-1863653854 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:40:16 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-abc29d91-3da7-4e76-8659-77c01751b401 tempest-GroupsTest-1863653854 None] Delete group completed successfully. Jul 11 18:40:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5642943b-56aa-437b-887b-c1c3505ec700 tempest-GroupsTest-1863653854 None] Group tempest-GroupsTest-Group-92475526: creating Jul 11 18:40:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5642943b-56aa-437b-887b-c1c3505ec700 tempest-GroupsTest-1863653854 None] Group tempest-GroupsTest-Group-92475526: created successfully Jul 11 18:40:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5642943b-56aa-437b-887b-c1c3505ec700 tempest-GroupsTest-1863653854 None] Create group completed successfully. Jul 11 18:40:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Acquiring lock "cinder-339d4287-a024-4513-8423-1082913deaa9-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:40:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Lock "cinder-339d4287-a024-4513-8423-1082913deaa9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:40:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Acquiring lock "cinder-quobyte-339d4287-a024-4513-8423-1082913deaa9" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:40:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Lock "cinder-quobyte-339d4287-a024-4513-8423-1082913deaa9" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:40:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3444be-564d-498f-a344-5a0a1f1674f4]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:40:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:17 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 Jul 11 18:40:17 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:18 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9" returned: 0 in 1.022s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:18 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9 Jul 11 18:40:18 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Flow 'volume_create_manager' (8e97dd55-0706-4735-b323-0c6bde499bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8aec5bd-1877-4fa7-bcba-5f530e46c1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8aec5bd-1877-4fa7-bcba-5f530e46c1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1238562976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49da8cdf-dfc4-4e99-9731-e438e63077f6,host='devstack@QuobyteHD#QuobyteHD',id=62135957-551a-4616-9c52-61d6428ae6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893276e8f1474e49bffcb5cc2d99a0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:19Z,use_quota=True,user_id='4020726cff4d4b9b8bf502292304bd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80a34965-e171-4594-ac9c-0ac45335d282),volume_type_id=80a34965-e171-4594-ac9c-0ac45335d282)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e29164-4245-4582-acb6-8e35a55117c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e29164-4245-4582-acb6-8e35a55117c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71bdfcf-5af9-4ca5-82dd-50291fc024c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71bdfcf-5af9-4ca5-82dd-50291fc024c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62135957-551a-4616-9c52-61d6428ae6ce', 'volume_name': 'volume-62135957-551a-4616-9c52-61d6428ae6ce', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03720f88-cae3-41ff-9d80-728c5deb082b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03720f88-cae3-41ff-9d80-728c5deb082b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e0b1c9-02f7-4181-85e0-727b731f1138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:19 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Volume 62135957-551a-4616-9c52-61d6428ae6ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62135957-551a-4616-9c52-61d6428ae6ce', 'volume_size': 1} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49da8cdf-dfc4-4e99-9731-e438e63077f6,created_at=2026-07-11T16:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1238562976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49da8cdf-dfc4-4e99-9731-e438e63077f6,host='devstack@QuobyteHD#QuobyteHD',id=62135957-551a-4616-9c52-61d6428ae6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893276e8f1474e49bffcb5cc2d99a0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:19Z,use_quota=True,user_id='4020726cff4d4b9b8bf502292304bd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80a34965-e171-4594-ac9c-0ac45335d282),volume_type_id=80a34965-e171-4594-ac9c-0ac45335d282)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Creating volume 62135957-551a-4616-9c52-61d6428ae6ce {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:40:19 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:19 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce 1073741824 Jul 11 18:40:19 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:19 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-339d4287-a024-4513-8423-1082913deaa9" returned: 0 in 0.890s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Lock "cinder-quobyte-339d4287-a024-4513-8423-1082913deaa9" released by "delete_volume" :: held 1.968s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Created reservations ['4a6a79bc-16bb-4db0-af59-01a2cdcad7dc', 'ed09f5ea-4369-42eb-9577-357bdb2015d2', '1f352883-8a62-4eac-ae9b-f7170575a6f7', 'f1e17d9f-2ad3-4e5b-a768-fd36ca35703e'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:20 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:40:20 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:20 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce 1073741824" returned: 0 in 1.217s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:20 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce Jul 11 18:40:20 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:20 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.854s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:20 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:40:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Deleted volume successfully. Jul 11 18:40:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e26289ff-44a6-470b-9845-eea326b27b80 tempest-DeleteServersTestJSON-245638939 None] Lock "cinder-339d4287-a024-4513-8423-1082913deaa9-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:40:21 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce" returned: 0 in 0.768s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:40:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e0b1c9-02f7-4181-85e0-727b731f1138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62135957-551a-4616-9c52-61d6428ae6ce', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4878738-d300-4dd7-94af-bb324efcaf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:21 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Volume volume-62135957-551a-4616-9c52-61d6428ae6ce (62135957-551a-4616-9c52-61d6428ae6ce): created successfully Jul 11 18:40:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4878738-d300-4dd7-94af-bb324efcaf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Flow 'volume_create_manager' (8e97dd55-0706-4735-b323-0c6bde499bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:21 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2c319b01-82fe-46bf-ae93-e24a49c2b544 tempest-GroupsTest-1863653854 None] Created volume successfully. Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Flow 'volume_create_manager' (9af331bd-4eb4-405e-8d64-3aa2371d66d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31efa05-b769-47bd-8e56-89d2f7ce214d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31efa05-b769-47bd-8e56-89d2f7ce214d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1704673753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49da8cdf-dfc4-4e99-9731-e438e63077f6,host='devstack@QuobyteHD#QuobyteHD',id=5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893276e8f1474e49bffcb5cc2d99a0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:22Z,use_quota=True,user_id='4020726cff4d4b9b8bf502292304bd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80a34965-e171-4594-ac9c-0ac45335d282),volume_type_id=80a34965-e171-4594-ac9c-0ac45335d282)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6590a82-8549-47ea-9de2-aac1c7c2add9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6590a82-8549-47ea-9de2-aac1c7c2add9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379bb92d-5366-4f37-972d-aff3d3379c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379bb92d-5366-4f37-972d-aff3d3379c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2', 'volume_name': 'volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daae911b-6dfc-4ddd-8a95-df2f90fac189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daae911b-6dfc-4ddd-8a95-df2f90fac189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268ec68f-eff0-4797-ad1d-69677f884b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:22 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Volume 5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2', 'volume_size': 1} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49da8cdf-dfc4-4e99-9731-e438e63077f6,created_at=2026-07-11T16:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1704673753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49da8cdf-dfc4-4e99-9731-e438e63077f6,host='devstack@QuobyteHD#QuobyteHD',id=5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893276e8f1474e49bffcb5cc2d99a0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:40:22Z,use_quota=True,user_id='4020726cff4d4b9b8bf502292304bd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80a34965-e171-4594-ac9c-0ac45335d282),volume_type_id=80a34965-e171-4594-ac9c-0ac45335d282)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Creating volume 5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:40:22 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:40:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:22 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 1073741824 Jul 11 18:40:22 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:23 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 1073741824" returned: 0 in 0.961s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:23 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 Jul 11 18:40:23 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:24 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2" returned: 0 in 0.860s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:40:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268ec68f-eff0-4797-ad1d-69677f884b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81996bc-1eaa-4326-b200-b618a85201be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:40:24 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Volume volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 (5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2): created successfully Jul 11 18:40:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81996bc-1eaa-4326-b200-b618a85201be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:40:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Flow 'volume_create_manager' (9af331bd-4eb4-405e-8d64-3aa2371d66d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:40:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-935e1563-7512-484d-9d29-3a4f768188d8 tempest-GroupsTest-1863653854 None] Created volume successfully. Jul 11 18:40:25 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-09ed09a7-d8d7-4f81-906c-22eaa4e33a47 tempest-GroupsTest-1863653854 None] Update group completed successfully. Jul 11 18:40:26 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c9350a7e-7e4f-422d-8c2e-4749fa4a38ba tempest-GroupsTest-1863653854 None] Update group completed successfully. Jul 11 18:40:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Acquiring lock "cinder-quobyte-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:40:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Lock "cinder-quobyte-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:40:28 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce20175-c08f-4495-b721-d94b826ddb2f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:40:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:29 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 Jul 11 18:40:29 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:29 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2" returned: 0 in 1.092s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:29 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2 Jul 11 18:40:29 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:30 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2" returned: 0 in 0.922s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Lock "cinder-quobyte-5aa6bcc6-758c-4f86-b3d5-c2bb34a360a2" released by "delete_volume" :: held 2.104s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:40:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Acquiring lock "cinder-quobyte-62135957-551a-4616-9c52-61d6428ae6ce" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:40:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Lock "cinder-quobyte-62135957-551a-4616-9c52-61d6428ae6ce" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:40:30 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb7741b-dead-4557-bc6b-2b83a464fa5d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:40:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:31 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce Jul 11 18:40:31 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:31 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce" returned: 0 in 0.926s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:31 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce Jul 11 18:40:31 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:32 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-62135957-551a-4616-9c52-61d6428ae6ce" returned: 0 in 0.815s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Lock "cinder-quobyte-62135957-551a-4616-9c52-61d6428ae6ce" released by "delete_volume" :: held 1.786s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:40:32 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Created reservations ['69341915-6d97-4b89-8a3c-e1e3010cb2fc'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:40:32 devstack cinder-volume[87411]: WARNING cinder.quota [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-225137382 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-225137382, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:40:32 devstack cinder-volume[87411]: WARNING cinder.quota [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-225137382 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-225137382, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:40:32 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Created reservations ['bba061f0-df1b-4bfa-b10c-906079e27914', 'd0c155e2-ff79-4002-9dbc-219991a96f49', 'c1f3ce3d-e7cf-48d8-a18c-a28fbdf85204', '6ea29bdf-7f5c-47c2-a59c-056997cb4ea7'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:40:32 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Created reservations ['7ce80bc7-842c-491b-b1a2-466067f038fe', 'e6bd5a07-e1dc-4b1f-aee4-5ffa9bce8a32', 'e5a2b0e9-9d30-4d96-bd08-b61fe724ad1a', 'de35b0ec-4e2b-48be-a239-2739ef633df0'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:40:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:40:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:40:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:40:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:40:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:40:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:40:33 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:40:33 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:40:33 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Jul 11 18:40:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.787s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:40:33 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:40:33 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-06293ae7-8119-4c9e-8ef7-fb5ae89963ad tempest-GroupsTest-1863653854 None] Delete group completed successfully. Jul 11 18:40:43 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=56,cinder:INSERT=18,cinder:UPDATE=60,cinder:DELETE=2 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:40:43 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=63,cinder:INSERT=9,cinder:UPDATE=72,cinder:DELETE=4 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Flow 'volume_create_manager' (d105caea-fad2-48dc-b442-434a795e02f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f7b1e6-0858-4732-8497-f2df7397d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f7b1e6-0858-4732-8497-f2df7397d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1778704814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32612b3c-32df-482e-a598-56016a38d863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ba18f40203440fa0f152d40ba354ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:06Z,use_quota=True,user_id='291d707d25a748279259fb0e31414b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aeab54c-a64d-4475-a763-d86016c3fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aeab54c-a64d-4475-a763-d86016c3fccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08b4cb5-11f0-4382-8487-9dc66b272627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08b4cb5-11f0-4382-8487-9dc66b272627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32612b3c-32df-482e-a598-56016a38d863', 'volume_name': 'volume-32612b3c-32df-482e-a598-56016a38d863', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb202b00-03ff-445b-9a17-55c929fc086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb202b00-03ff-445b-9a17-55c929fc086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b13fc56-dc31-4352-93f5-cd837eca9d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:06 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Volume 32612b3c-32df-482e-a598-56016a38d863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32612b3c-32df-482e-a598-56016a38d863', 'volume_size': 1} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1778704814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32612b3c-32df-482e-a598-56016a38d863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ba18f40203440fa0f152d40ba354ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:06Z,use_quota=True,user_id='291d707d25a748279259fb0e31414b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Creating volume 32612b3c-32df-482e-a598-56016a38d863 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:06 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:41:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:06 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 1073741824 Jul 11 18:41:06 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:07 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 1073741824" returned: 0 in 1.033s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:07 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 Jul 11 18:41:07 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:08 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863" returned: 0 in 0.656s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:41:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:08 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b13fc56-dc31-4352-93f5-cd837eca9d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32612b3c-32df-482e-a598-56016a38d863', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:08 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b12f50b-a016-42d6-82a2-d292371319ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:08 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Volume volume-32612b3c-32df-482e-a598-56016a38d863 (32612b3c-32df-482e-a598-56016a38d863): created successfully Jul 11 18:41:08 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b12f50b-a016-42d6-82a2-d292371319ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:08 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Flow 'volume_create_manager' (d105caea-fad2-48dc-b442-434a795e02f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:08 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b4bc581f-7de6-4354-8606-34b437440e78 tempest-TaggedAttachmentsTest-502792559 None] Created volume successfully. Jul 11 18:41:08 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:08 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Flow 'volume_create_manager' (19595751-5165-4256-8d3c-4e215b445086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94be6356-ef3d-4c35-a150-a6be328421bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94be6356-ef3d-4c35-a150-a6be328421bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-942532158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2626ec-0296-4770-aa93-b8529c7738f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc38eae93af4d9e8101779917490e06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:09Z,use_quota=True,user_id='c2dee1d4ee5b46a48d86b6645e45541e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121cc63a-a9bb-4a51-aeb4-318da2509b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121cc63a-a9bb-4a51-aeb4-318da2509b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0b1c99-c431-47e5-b351-1ef6f8369d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0b1c99-c431-47e5-b351-1ef6f8369d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d2626ec-0296-4770-aa93-b8529c7738f4', 'volume_name': 'volume-0d2626ec-0296-4770-aa93-b8529c7738f4', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6d2e8a-e080-4eda-954e-8ed58ec78dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6d2e8a-e080-4eda-954e-8ed58ec78dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f214fd-5f14-4644-90d5-813861a45b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:09 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Volume 0d2626ec-0296-4770-aa93-b8529c7738f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d2626ec-0296-4770-aa93-b8529c7738f4', 'volume_size': 1} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-942532158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2626ec-0296-4770-aa93-b8529c7738f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc38eae93af4d9e8101779917490e06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:09Z,use_quota=True,user_id='c2dee1d4ee5b46a48d86b6645e45541e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Creating volume 0d2626ec-0296-4770-aa93-b8529c7738f4 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:09 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:41:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:09 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4 1073741824 Jul 11 18:41:09 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:10 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4 1073741824" returned: 0 in 0.944s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:10 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4 Jul 11 18:41:10 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:10 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4" returned: 0 in 0.702s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:41:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f214fd-5f14-4644-90d5-813861a45b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2626ec-0296-4770-aa93-b8529c7738f4', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a7cf65-700a-4e70-86fa-a5269e15baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:10 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Volume volume-0d2626ec-0296-4770-aa93-b8529c7738f4 (0d2626ec-0296-4770-aa93-b8529c7738f4): created successfully Jul 11 18:41:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a7cf65-700a-4e70-86fa-a5269e15baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Flow 'volume_create_manager' (19595751-5165-4256-8d3c-4e215b445086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:10 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-47982fee-d408-49ed-ab2e-a031c483e05a tempest-VolumesServicesTestJSON-1082804226 None] Created volume successfully. Jul 11 18:41:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Acquiring lock "cinder-0d2626ec-0296-4770-aa93-b8529c7738f4-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Lock "cinder-0d2626ec-0296-4770-aa93-b8529c7738f4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Acquiring lock "cinder-quobyte-0d2626ec-0296-4770-aa93-b8529c7738f4" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Lock "cinder-quobyte-0d2626ec-0296-4770-aa93-b8529c7738f4" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:11 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b4a94-a309-4134-a353-7e8150a8bf68]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:11 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4 Jul 11 18:41:11 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:12 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4" returned: 0 in 0.901s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:12 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4 Jul 11 18:41:12 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:13 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d2626ec-0296-4770-aa93-b8529c7738f4" returned: 0 in 1.149s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Lock "cinder-quobyte-0d2626ec-0296-4770-aa93-b8529c7738f4" released by "delete_volume" :: held 2.131s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:13 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Created reservations ['31cd7e95-6cb7-47b4-9ebb-70a21dee531c', '0cae14b0-69e1-4814-a7b6-63f8628ae2c4', 'd5a1422c-196b-4c2d-9030-30ac5f79b925', '8e3f2c64-21df-4361-967b-f9c7ee1cc31c'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:41:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:13 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:41:13 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:14 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.916s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:14 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:41:14 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Deleted volume successfully. Jul 11 18:41:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9238f887-55ae-412b-8fad-6572a887d120 tempest-VolumesServicesTestJSON-1082804226 None] Lock "cinder-0d2626ec-0296-4770-aa93-b8529c7738f4-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Flow 'volume_create_manager' (8629034f-257a-4355-9b81-709a2916b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc30a32-bb6c-4040-8b5b-47098d0c591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc30a32-bb6c-4040-8b5b-47098d0c591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1444766551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f83c34d-5552-4022-9534-241c086dbd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285fb89837844eafa38a5aa91d36e458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:20Z,use_quota=True,user_id='720471179d954234805d7272b7c84433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d37ff26-ebb8-49cb-b4ca-7f3673ecbc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d37ff26-ebb8-49cb-b4ca-7f3673ecbc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f9923b-6e7e-4a91-8012-3e4f68cbe065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f9923b-6e7e-4a91-8012-3e4f68cbe065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f83c34d-5552-4022-9534-241c086dbd8e', 'volume_name': 'volume-7f83c34d-5552-4022-9534-241c086dbd8e', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5deaab2f-3051-4032-a295-3cbecf0e1ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5deaab2f-3051-4032-a295-3cbecf0e1ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663b2e56-ef1a-48f9-9879-2ef6709d14af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:20 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Volume 7f83c34d-5552-4022-9534-241c086dbd8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f83c34d-5552-4022-9534-241c086dbd8e', 'volume_size': 1} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1444766551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f83c34d-5552-4022-9534-241c086dbd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='285fb89837844eafa38a5aa91d36e458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:20Z,use_quota=True,user_id='720471179d954234805d7272b7c84433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Creating volume 7f83c34d-5552-4022-9534-241c086dbd8e {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:20 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:41:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:20 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e 1073741824 Jul 11 18:41:20 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:21 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e 1073741824" returned: 0 in 1.074s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:21 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e Jul 11 18:41:21 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:21 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Flow 'volume_create_manager' (1a78d583-d2f0-4c92-aa5e-fcc25bc56c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1723e72-eeeb-4e88-a13d-f09943228554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1723e72-eeeb-4e88-a13d-f09943228554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-833493545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5d798b-e919-47e5-91c3-6e25f710b3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b5bb286e0b43b88a8b3611b92c6107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:22Z,use_quota=True,user_id='a0def4f2717d41edb8d73457e9610741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328bffe4-a205-4c65-b1f4-1578668b7110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328bffe4-a205-4c65-b1f4-1578668b7110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0bdfef-78fc-468d-ac94-45fd2289ab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0bdfef-78fc-468d-ac94-45fd2289ab83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5d798b-e919-47e5-91c3-6e25f710b3b5', 'volume_name': 'volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd62064-4313-4c8a-9b93-0cf16ec1137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd62064-4313-4c8a-9b93-0cf16ec1137e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d0220e-fb0b-495e-ab0d-4aac81c07f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:22 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Volume ff5d798b-e919-47e5-91c3-6e25f710b3b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5', 'volume_size': 1} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:22 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e" returned: 0 in 0.899s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.230s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-833493545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5d798b-e919-47e5-91c3-6e25f710b3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b5bb286e0b43b88a8b3611b92c6107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:22Z,use_quota=True,user_id='a0def4f2717d41edb8d73457e9610741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Creating volume ff5d798b-e919-47e5-91c3-6e25f710b3b5 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:22 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663b2e56-ef1a-48f9-9879-2ef6709d14af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f83c34d-5552-4022-9534-241c086dbd8e', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7a4f68-4f66-4b8b-aa20-068af4e90bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:22 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5 1073741824 Jul 11 18:41:22 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:22 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Volume volume-7f83c34d-5552-4022-9534-241c086dbd8e (7f83c34d-5552-4022-9534-241c086dbd8e): created successfully Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7a4f68-4f66-4b8b-aa20-068af4e90bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Flow 'volume_create_manager' (8629034f-257a-4355-9b81-709a2916b682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:22 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-abc08eae-7fe3-4e19-9d9c-22a65d64f94c tempest-AttachVolumeShelveTestJSON-392332775 None] Created volume successfully. Jul 11 18:41:23 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5 1073741824" returned: 0 in 1.325s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:23 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5 Jul 11 18:41:23 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:24 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5" returned: 0 in 0.857s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:41:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d0220e-fb0b-495e-ab0d-4aac81c07f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fafdbe-7735-4c15-88cf-9deceeeb99c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:24 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Volume volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5 (ff5d798b-e919-47e5-91c3-6e25f710b3b5): created successfully Jul 11 18:41:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fafdbe-7735-4c15-88cf-9deceeeb99c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Flow 'volume_create_manager' (1a78d583-d2f0-4c92-aa5e-fcc25bc56c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-622b70c6-5b93-4abd-b60d-ab16d6c321ff tempest-ServersNegativeTestJSON-1676791512 None] Created volume successfully. Jul 11 18:41:26 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Flow 'volume_create_manager' (d7004012-b5dd-4786-9639-cc6a1ab5cf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b14e2ea-8aa6-436b-8019-4ede0ccf95f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b14e2ea-8aa6-436b-8019-4ede0ccf95f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-768498622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1247c3c-a345-4a19-a57d-33b341ffd369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b5bb286e0b43b88a8b3611b92c6107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:27Z,use_quota=True,user_id='a0def4f2717d41edb8d73457e9610741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0898d57-8f85-48c5-bb6b-4f143b2ac94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0898d57-8f85-48c5-bb6b-4f143b2ac94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9205cd-3ce7-4c37-83cc-6c9d5147c088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9205cd-3ce7-4c37-83cc-6c9d5147c088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1247c3c-a345-4a19-a57d-33b341ffd369', 'volume_name': 'volume-c1247c3c-a345-4a19-a57d-33b341ffd369', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e172b50-a915-4a0c-8cb7-9608034f0be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e172b50-a915-4a0c-8cb7-9608034f0be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f493515-4c87-4c54-aa31-3e215c11dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:27 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Volume c1247c3c-a345-4a19-a57d-33b341ffd369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1247c3c-a345-4a19-a57d-33b341ffd369', 'volume_size': 1} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-768498622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1247c3c-a345-4a19-a57d-33b341ffd369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b5bb286e0b43b88a8b3611b92c6107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:27Z,use_quota=True,user_id='a0def4f2717d41edb8d73457e9610741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Creating volume c1247c3c-a345-4a19-a57d-33b341ffd369 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:27 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:41:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:27 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369 1073741824 Jul 11 18:41:27 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:28 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369 1073741824" returned: 0 in 1.270s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:28 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369 Jul 11 18:41:28 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:29 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369" returned: 0 in 1.080s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] <== create_volume: return (2411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:41:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f493515-4c87-4c54-aa31-3e215c11dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1247c3c-a345-4a19-a57d-33b341ffd369', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b484bd8c-7b4a-4b2b-a0ef-e730183a92e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:29 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Volume volume-c1247c3c-a345-4a19-a57d-33b341ffd369 (c1247c3c-a345-4a19-a57d-33b341ffd369): created successfully Jul 11 18:41:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b484bd8c-7b4a-4b2b-a0ef-e730183a92e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Flow 'volume_create_manager' (d7004012-b5dd-4786-9639-cc6a1ab5cf7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:29 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-38e308e3-1f68-4752-ab6d-a693ce4d293c tempest-ServersNegativeTestJSON-1676791512 None] Created volume successfully. Jul 11 18:41:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Acquiring lock "cinder-c1247c3c-a345-4a19-a57d-33b341ffd369-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Lock "cinder-c1247c3c-a345-4a19-a57d-33b341ffd369-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Acquiring lock "cinder-quobyte-c1247c3c-a345-4a19-a57d-33b341ffd369" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Lock "cinder-quobyte-c1247c3c-a345-4a19-a57d-33b341ffd369" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:31 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1610d52-1377-4030-a926-0c8b77ce6f45]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:31 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369 Jul 11 18:41:31 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:32 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369" returned: 0 in 1.324s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:32 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369 Jul 11 18:41:32 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:33 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c1247c3c-a345-4a19-a57d-33b341ffd369" returned: 0 in 0.878s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Lock "cinder-quobyte-c1247c3c-a345-4a19-a57d-33b341ffd369" released by "delete_volume" :: held 2.285s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:33 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Created reservations ['f153a431-aa84-45a7-a53a-16a1f72e332b', '9b0af68e-5b6f-456d-9a28-785c0a82e0cf', 'c27efcef-024d-40c1-8769-84720ed05601', '8f83a056-46b5-4aa3-950b-1f8d922704fe'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:41:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:34 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:41:34 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Acquiring lock "cinder-ff5d798b-e919-47e5-91c3-6e25f710b3b5-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Lock "cinder-ff5d798b-e919-47e5-91c3-6e25f710b3b5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Acquiring lock "cinder-quobyte-ff5d798b-e919-47e5-91c3-6e25f710b3b5" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:41:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Lock "cinder-quobyte-ff5d798b-e919-47e5-91c3-6e25f710b3b5" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:41:35 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cb2747-ea78-4b59-a692-218e492b78f1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:35 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5 Jul 11 18:41:35 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:35 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.383s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:35 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:41:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Deleted volume successfully. Jul 11 18:41:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1d7616d8-74d1-4da6-9090-a440cfacc94e tempest-ServersNegativeTestJSON-1676791512 None] Lock "cinder-c1247c3c-a345-4a19-a57d-33b341ffd369-delete_volume" released by "delete_volume" :: held 4.075s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:36 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5" returned: 0 in 1.009s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:36 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5 Jul 11 18:41:36 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:36 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff5d798b-e919-47e5-91c3-6e25f710b3b5" returned: 0 in 0.803s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Lock "cinder-quobyte-ff5d798b-e919-47e5-91c3-6e25f710b3b5" released by "delete_volume" :: held 1.869s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:37 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Created reservations ['b186866c-829d-48b0-bdbc-ee0a3616af30', '6846bc07-93d5-4abf-b50e-04cf735dcba1', '3b7b82f2-b2f3-4ea8-b8ec-057a59f6eed6', 'cafa03c3-2f7c-4a14-bc09-5393c06a74ca'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:41:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:37 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:41:37 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:38 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.118s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:38 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:41:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Deleted volume successfully. Jul 11 18:41:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-daf51518-856e-4764-acc9-4a15e5e72457 tempest-ServersNegativeTestJSON-1676791512 None] Lock "cinder-ff5d798b-e919-47e5-91c3-6e25f710b3b5-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:41:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-d455582e-af95-4c7b-a9c5-c2038f0f7651 req-192c95e8-66ea-417b-a85b-651a7d3a187d tempest-AttachVolumeShelveTestJSON-392332775 None] No connector for attachment cfc23ef4-42b0-46eb-b10c-a41bd4de2826; skipping storage backend terminate_connection call. {{(pid=87411) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 11 18:41:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-d455582e-af95-4c7b-a9c5-c2038f0f7651 req-192c95e8-66ea-417b-a85b-651a7d3a187d tempest-AttachVolumeShelveTestJSON-392332775 None] Deleting attachment cfc23ef4-42b0-46eb-b10c-a41bd4de2826. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:41:48 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=32,cinder:UPDATE=37,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:41:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:41:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:51 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:41:51 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:52 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.709s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:41:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:41:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 8 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:41:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Flow 'volume_create_manager' (4f3570b5-f34c-4dcf-b3a4-3c1c191ddbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b5a230-e4fe-4f76-a2cb-55e395400688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b5a230-e4fe-4f76-a2cb-55e395400688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1395109354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc65345-7d5c-40db-b350-d95a520f0008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62558c33d9984b918935f2656cbe018f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:53Z,use_quota=True,user_id='13aca8c1c8444025b1b0585f24853836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f1a2a6-ad12-425b-97da-4abe171b35d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f1a2a6-ad12-425b-97da-4abe171b35d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5dd296-8f3a-406b-a547-8666b34876b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5dd296-8f3a-406b-a547-8666b34876b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc65345-7d5c-40db-b350-d95a520f0008', 'volume_name': 'volume-1fc65345-7d5c-40db-b350-d95a520f0008', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630d36bb-f0c3-4c4c-aef6-62420bde8656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630d36bb-f0c3-4c4c-aef6-62420bde8656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c7ded6-855e-4700-9958-0e73bdfeadb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:53 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Volume 1fc65345-7d5c-40db-b350-d95a520f0008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc65345-7d5c-40db-b350-d95a520f0008', 'volume_size': 1} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1395109354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc65345-7d5c-40db-b350-d95a520f0008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62558c33d9984b918935f2656cbe018f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:41:53Z,use_quota=True,user_id='13aca8c1c8444025b1b0585f24853836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Creating volume 1fc65345-7d5c-40db-b350-d95a520f0008 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:41:53 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:41:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:53 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 1073741824 Jul 11 18:41:53 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:54 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 1073741824" returned: 0 in 1.078s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:54 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 Jul 11 18:41:54 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:55 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008" returned: 0 in 0.682s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:41:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:41:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c7ded6-855e-4700-9958-0e73bdfeadb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc65345-7d5c-40db-b350-d95a520f0008', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e8fe81-6812-4fff-9fa1-a37d50267ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:41:55 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Volume volume-1fc65345-7d5c-40db-b350-d95a520f0008 (1fc65345-7d5c-40db-b350-d95a520f0008): created successfully Jul 11 18:41:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e8fe81-6812-4fff-9fa1-a37d50267ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:41:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Flow 'volume_create_manager' (4f3570b5-f34c-4dcf-b3a4-3c1c191ddbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:41:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-b9b1cca9-6190-42b5-8768-41d9025f6a0e req-b33865dc-2b7f-48b5-a092-301367a809db tempest-VolumesSnapshotsTestJSON-1655507363 None] Created volume successfully. Jul 11 18:41:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:41:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:41:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Creating offline snapshot 2f8162f4-b648-45eb-8bb7-ec1154e24d94 of volume 1fc65345-7d5c-40db-b350-d95a520f0008 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:41:56 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a238c642-59df-4c7e-96b4-027cedf3fa9a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:41:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:57 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 Jul 11 18:41:57 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:58 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008" returned: 0 in 1.257s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:58 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 1G Jul 11 18:41:58 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:41:59 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Jul 11 18:41:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 1G" returned: 0 in 0.935s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:41:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc65345-7d5c-40db-b350-d95a520f0008 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:41:59 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc65345-7d5c-40db-b350-d95a520f0008 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 Jul 11 18:41:59 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:00 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc65345-7d5c-40db-b350-d95a520f0008 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94" returned: 0 in 1.161s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:00 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 is being set with open permissions: ugo+rw Jul 11 18:42:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:00 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 Jul 11 18:42:00 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:00 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94" returned: 0 in 0.704s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:01 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.info Jul 11 18:42:01 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:01 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.info" returned: 0 in 0.665s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:01 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.info is being set with open permissions: ugo+rw Jul 11 18:42:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:01 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.info Jul 11 18:42:01 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:02 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.info" returned: 0 in 1.182s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:02 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-f76736e5-b5d8-4615-bdb3-7c8d5f381c07 req-a367d393-50da-4e03-a444-a7231d3a16fa tempest-VolumesSnapshotsTestJSON-1655507363 None] Create snapshot completed successfully Jul 11 18:42:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Acquiring lock "cinder-2f8162f4-b648-45eb-8bb7-ec1154e24d94-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "cinder-2f8162f4-b648-45eb-8bb7-ec1154e24d94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Acquiring lock "cinder-quobyte-1fc65345-7d5c-40db-b350-d95a520f0008" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "cinder-quobyte-1fc65345-7d5c-40db-b350-d95a520f0008" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Acquiring lock "cinder-quobyte-2f8162f4-b648-45eb-8bb7-ec1154e24d94" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "cinder-quobyte-2f8162f4-b648-45eb-8bb7-ec1154e24d94" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Deleting offline snapshot 2f8162f4-b648-45eb-8bb7-ec1154e24d94 of volume 1fc65345-7d5c-40db-b350-d95a520f0008 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:42:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] snapshot_file for this snap is: volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:42:04 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[449a31c6-183c-4a27-882f-6d01959a7786]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:04 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 Jul 11 18:42:04 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:05 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94" returned: 0 in 1.176s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc65345-7d5c-40db-b350-d95a520f0008(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:42:05 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e902ad2-637a-462a-b62d-98ffe798cb4b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:05 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 Jul 11 18:42:05 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:06 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008" returned: 0 in 1.118s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:06 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 Jul 11 18:42:06 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=47,cinder:SELECT=27,cinder:DELETE=4,cinder:INSERT=9 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-10f5a080-ba36-4b96-9bc6-d7674911c8c2 req-23fa8149-50f1-4125-8c76-381107f2d00c tempest-TaggedAttachmentsTest-502792559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-10f5a080-ba36-4b96-9bc6-d7674911c8c2 req-23fa8149-50f1-4125-8c76-381107f2d00c tempest-TaggedAttachmentsTest-502792559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6435c5-251d-4bbe-8e9e-87d94082b9cb]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-10f5a080-ba36-4b96-9bc6-d7674911c8c2 req-23fa8149-50f1-4125-8c76-381107f2d00c tempest-TaggedAttachmentsTest-502792559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:07 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 Jul 11 18:42:07 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (c3800092-eed6-4150-92fd-28508f9cf24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10791f79-5de9-4ead-bf75-c242c96a0662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10791f79-5de9-4ead-bf75-c242c96a0662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439096826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8c45e4-5888-46b4-b73f-24879d699d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:08Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e95245-2854-4896-bf91-bfdb42a94899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e95245-2854-4896-bf91-bfdb42a94899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286f2052-4349-4e68-bfc0-fa4e50c7542e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286f2052-4349-4e68-bfc0-fa4e50c7542e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8c45e4-5888-46b4-b73f-24879d699d6a', 'volume_name': 'volume-bf8c45e4-5888-46b4-b73f-24879d699d6a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:07 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c36108-3f2b-4eaf-a347-82bdcd8a7b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c36108-3f2b-4eaf-a347-82bdcd8a7b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9daee934-3ab4-43d5-abab-5cfa3adc0d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:07 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Volume bf8c45e4-5888-46b4-b73f-24879d699d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8c45e4-5888-46b4-b73f-24879d699d6a', 'volume_size': 1} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94" returned: 0 in 1.274s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:07 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94 Jul 11 18:42:07 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:08 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-10f5a080-ba36-4b96-9bc6-d7674911c8c2 req-23fa8149-50f1-4125-8c76-381107f2d00c tempest-TaggedAttachmentsTest-502792559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863" returned: 0 in 1.464s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-10f5a080-ba36-4b96-9bc6-d7674911c8c2 req-23fa8149-50f1-4125-8c76-381107f2d00c tempest-TaggedAttachmentsTest-502792559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.538s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439096826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8c45e4-5888-46b4-b73f-24879d699d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:08Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Creating volume bf8c45e4-5888-46b4-b73f-24879d699d6a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:08 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:08 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a 1073741824 Jul 11 18:42:08 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:08 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-10f5a080-ba36-4b96-9bc6-d7674911c8c2 req-23fa8149-50f1-4125-8c76-381107f2d00c tempest-TaggedAttachmentsTest-502792559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-32612b3c-32df-482e-a598-56016a38d863', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0645483f-1509-407e-af4b-2693747e582a', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:42:08 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-10f5a080-ba36-4b96-9bc6-d7674911c8c2 req-23fa8149-50f1-4125-8c76-381107f2d00c tempest-TaggedAttachmentsTest-502792559 None] attachment_update completed successfully. Jul 11 18:42:09 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008.2f8162f4-b648-45eb-8bb7-ec1154e24d94" returned: 0 in 1.200s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "cinder-quobyte-2f8162f4-b648-45eb-8bb7-ec1154e24d94" released by "_delete_snapshot" :: held 5.019s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "cinder-quobyte-1fc65345-7d5c-40db-b350-d95a520f0008" released by "delete_snapshot" :: held 5.074s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:09 devstack cinder-volume[87411]: WARNING cinder.quota [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:42:09 devstack cinder-volume[87411]: DEBUG cinder.quota [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Created reservations ['781cd1d8-c37a-4417-a319-7df06e426c0a', '0f9dc6d8-598a-4052-aa80-cc363380c150', '9f0f6814-8e74-4f48-933e-1ef69acfd02e', '249b0085-598a-4295-a609-48be0f4c2d51'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:09 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Delete snapshot completed successfully. Jul 11 18:42:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-356453f2-727f-42d2-b9cf-60f495fb002a req-bd8053c5-529b-4923-9f01-2e81c949b51b tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "cinder-2f8162f4-b648-45eb-8bb7-ec1154e24d94-delete_snapshot" released by "delete_snapshot" :: held 5.469s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Acquiring lock "cinder-1fc65345-7d5c-40db-b350-d95a520f0008-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "cinder-1fc65345-7d5c-40db-b350-d95a520f0008-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Acquiring lock "cinder-quobyte-1fc65345-7d5c-40db-b350-d95a520f0008" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "cinder-quobyte-1fc65345-7d5c-40db-b350-d95a520f0008" acquired by "delete_volume" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:10 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8781fb8c-03b6-4205-9b11-859b9daa7e7d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:10 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a 1073741824" returned: 0 in 1.427s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:10 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 Jul 11 18:42:10 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:10 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a Jul 11 18:42:10 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:11 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008" returned: 0 in 1.132s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:11 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008 Jul 11 18:42:11 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:11 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a" returned: 0 in 1.019s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] <== create_volume: return (2553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.557s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9daee934-3ab4-43d5-abab-5cfa3adc0d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8c45e4-5888-46b4-b73f-24879d699d6a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121dfc2b-a00e-41b6-b6c9-963c15b9ce08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:11 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Volume volume-bf8c45e4-5888-46b4-b73f-24879d699d6a (bf8c45e4-5888-46b4-b73f-24879d699d6a): created successfully Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121dfc2b-a00e-41b6-b6c9-963c15b9ce08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (c3800092-eed6-4150-92fd-28508f9cf24d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:11 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d49abfda-e730-4acd-8bbc-7c1c6231672a tempest-VolumesActionsTest-393641591 None] Created volume successfully. Jul 11 18:42:11 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1fc65345-7d5c-40db-b350-d95a520f0008" returned: 0 in 0.673s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "cinder-quobyte-1fc65345-7d5c-40db-b350-d95a520f0008" released by "delete_volume" :: held 1.873s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:11 devstack cinder-volume[87411]: DEBUG cinder.quota [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Created reservations ['debfd1f1-de38-41dd-8d39-d88e6b0aa19a', '25f8c873-60f3-4f87-b781-1cad682dad45', 'cf995e98-a5e5-4499-9e2f-f8252931e593', '1e8a48db-101a-423d-a874-f9c49a712ebb'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:12 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:42:12 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-99d8ac7c-8942-461e-90e2-51ad4c812c67 tempest-VolumesActionsTest-393641591 None] Acquiring lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a" by "attach_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-99d8ac7c-8942-461e-90e2-51ad4c812c67 tempest-VolumesActionsTest-393641591 None] Lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a" acquired by "attach_volume" :: waited 0.029s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:12 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-99d8ac7c-8942-461e-90e2-51ad4c812c67 tempest-VolumesActionsTest-393641591 None] Attaching volume bf8c45e4-5888-46b4-b73f-24879d699d6a to instance 459739b2-e556-417c-a36f-23d356092b18 at mountpoint /dev/vdb on host None. Jul 11 18:42:12 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-99d8ac7c-8942-461e-90e2-51ad4c812c67 tempest-VolumesActionsTest-393641591 None] Attach volume completed successfully. Jul 11 18:42:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-99d8ac7c-8942-461e-90e2-51ad4c812c67 tempest-VolumesActionsTest-393641591 None] Lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a" released by "attach_volume" :: held 0.154s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:13 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.161s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:13 devstack cinder-volume[87411]: DEBUG cinder.manager [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:13 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Deleted volume successfully. Jul 11 18:42:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-944f8736-c1be-4c8c-b70b-be8b66f01061 req-14a82c79-3183-40b6-803f-d30d3c9f3c6e tempest-VolumesSnapshotsTestJSON-1655507363 None] Lock "cinder-1fc65345-7d5c-40db-b350-d95a520f0008-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:13 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d8371fb7-b6d2-4aeb-994a-b7e8d2ff8ccc tempest-VolumesActionsTest-1526493618 None] Terminate volume connection completed successfully. Jul 11 18:42:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d8371fb7-b6d2-4aeb-994a-b7e8d2ff8ccc tempest-VolumesActionsTest-1526493618 None] Acquiring lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a-detach_volume" by "detach_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d8371fb7-b6d2-4aeb-994a-b7e8d2ff8ccc tempest-VolumesActionsTest-1526493618 None] Lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:14 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d8371fb7-b6d2-4aeb-994a-b7e8d2ff8ccc tempest-VolumesActionsTest-1526493618 None] Detaching volume bf8c45e4-5888-46b4-b73f-24879d699d6a from instance 459739b2-e556-417c-a36f-23d356092b18. Jul 11 18:42:14 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d8371fb7-b6d2-4aeb-994a-b7e8d2ff8ccc tempest-VolumesActionsTest-1526493618 None] Detach volume completed successfully. Jul 11 18:42:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d8371fb7-b6d2-4aeb-994a-b7e8d2ff8ccc tempest-VolumesActionsTest-1526493618 None] Lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0587900f-ab58-4fba-8055-a10a5f17d66c tempest-VolumesActionsTest-393641591 None] Acquiring lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a-detach_volume" by "detach_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0587900f-ab58-4fba-8055-a10a5f17d66c tempest-VolumesActionsTest-393641591 None] Lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0587900f-ab58-4fba-8055-a10a5f17d66c tempest-VolumesActionsTest-393641591 None] Volume detach called, but volume not attached. Jul 11 18:42:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0587900f-ab58-4fba-8055-a10a5f17d66c tempest-VolumesActionsTest-393641591 None] Lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Acquiring lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Acquiring lock "cinder-quobyte-bf8c45e4-5888-46b4-b73f-24879d699d6a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Lock "cinder-quobyte-bf8c45e4-5888-46b4-b73f-24879d699d6a" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:16 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[47831fb6-a5ad-4de7-8863-19b7c5cd8f04]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:16 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a Jul 11 18:42:16 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:17 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a" returned: 0 in 1.113s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:17 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a Jul 11 18:42:17 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-f4785d71-875e-4f97-9c00-ffb8e0a8e422 req-32f7b12a-5305-42de-ab11-4a0aa3e495de tempest-TaggedAttachmentsTest-502792559 None] Terminate volume connection completed successfully. Jul 11 18:42:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f4785d71-875e-4f97-9c00-ffb8e0a8e422 req-32f7b12a-5305-42de-ab11-4a0aa3e495de tempest-TaggedAttachmentsTest-502792559 None] Deleting attachment 0645483f-1509-407e-af4b-2693747e582a. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:42:18 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bf8c45e4-5888-46b4-b73f-24879d699d6a" returned: 0 in 1.143s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Lock "cinder-quobyte-bf8c45e4-5888-46b4-b73f-24879d699d6a" released by "delete_volume" :: held 2.328s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9d9ab99d-96d3-4b53-843d-f7f4231c8931 tempest-GroupSnapshotsTest-685195388 None] Group tempest-GroupSnapshotsTest-Group-1250129792: creating Jul 11 18:42:18 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Created reservations ['daf4c7a4-17e0-4755-a964-5baca6baa0a7', '4d30bec0-037c-4368-bcfd-9d606d834413', 'f1d3be55-6c69-4c34-ae25-00784392eb99', 'b164b96a-3ede-481d-bc6b-22d80ac5b855'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9d9ab99d-96d3-4b53-843d-f7f4231c8931 tempest-GroupSnapshotsTest-685195388 None] Group tempest-GroupSnapshotsTest-Group-1250129792: created successfully Jul 11 18:42:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9d9ab99d-96d3-4b53-843d-f7f4231c8931 tempest-GroupSnapshotsTest-685195388 None] Create group completed successfully. Jul 11 18:42:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:18 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:42:18 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:19 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.825s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:19 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:19 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Deleted volume successfully. Jul 11 18:42:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-40e8812e-e121-4143-b741-8cc48701d646 tempest-VolumesActionsTest-393641591 None] Lock "cinder-bf8c45e4-5888-46b4-b73f-24879d699d6a-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Flow 'volume_create_manager' (bd3b31ef-fa16-4c21-902c-40cb12170ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8842ed4-72b2-4398-af96-2152ca54bb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8842ed4-72b2-4398-af96-2152ca54bb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1082667480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3ecc63f-7031-4dd1-b266-53ef7b110ba6,host='devstack@QuobyteHD#QuobyteHD',id=f02d362c-7f76-49e5-b226-976dbbd51728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc2009b5f1143ebba9cf2e69b15b39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:20Z,use_quota=True,user_id='73c8b747ced3469894c38f3e73808d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7398d23-72d5-4512-89c7-27be1976d9a9),volume_type_id=c7398d23-72d5-4512-89c7-27be1976d9a9)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8784bc05-ef15-408e-8d50-3fdbc8464fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8784bc05-ef15-408e-8d50-3fdbc8464fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bbb867-f99f-4ddd-8fac-b43551205797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bbb867-f99f-4ddd-8fac-b43551205797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02d362c-7f76-49e5-b226-976dbbd51728', 'volume_name': 'volume-f02d362c-7f76-49e5-b226-976dbbd51728', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0a294e-f0f9-4f5a-8c80-76130988ab54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0a294e-f0f9-4f5a-8c80-76130988ab54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622f25d7-3247-4ca9-be22-33f8bb9f071c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:20 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Volume f02d362c-7f76-49e5-b226-976dbbd51728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02d362c-7f76-49e5-b226-976dbbd51728', 'volume_size': 1} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3ecc63f-7031-4dd1-b266-53ef7b110ba6,created_at=2026-07-11T16:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1082667480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3ecc63f-7031-4dd1-b266-53ef7b110ba6,host='devstack@QuobyteHD#QuobyteHD',id=f02d362c-7f76-49e5-b226-976dbbd51728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc2009b5f1143ebba9cf2e69b15b39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:20Z,use_quota=True,user_id='73c8b747ced3469894c38f3e73808d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7398d23-72d5-4512-89c7-27be1976d9a9),volume_type_id=c7398d23-72d5-4512-89c7-27be1976d9a9)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Creating volume f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:20 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:42:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:20 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 1073741824 Jul 11 18:42:20 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:21 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 1073741824" returned: 0 in 1.525s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:22 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 Jul 11 18:42:22 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:23 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728" returned: 0 in 1.029s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] <== create_volume: return (2624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.626s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622f25d7-3247-4ca9-be22-33f8bb9f071c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02d362c-7f76-49e5-b226-976dbbd51728', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40bd707-e220-495c-9bd0-4b31ba9cac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:23 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Volume volume-f02d362c-7f76-49e5-b226-976dbbd51728 (f02d362c-7f76-49e5-b226-976dbbd51728): created successfully Jul 11 18:42:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40bd707-e220-495c-9bd0-4b31ba9cac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Flow 'volume_create_manager' (bd3b31ef-fa16-4c21-902c-40cb12170ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:23 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4d42c401-5ea2-4481-b67f-03fb1f5d407b tempest-GroupSnapshotsTest-685195388 None] Created volume successfully. Jul 11 18:42:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] GroupSnapshot 7896dd67-713b-434a-a744-942b95c8fb9f: creating. Jul 11 18:42:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Group snapshot 7896dd67-713b-434a-a744-942b95c8fb9f: creating. {{(pid=87411) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:42:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Creating offline snapshot eead09e4-65d4-485c-8042-52a65465e7ea of volume f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:42:24 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[596146e2-f968-424a-8425-0ac55e0836de]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:24 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 Jul 11 18:42:24 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:25 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728" returned: 0 in 0.748s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:25 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea 1G Jul 11 18:42:25 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:26 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea 1G" returned: 0 in 0.799s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02d362c-7f76-49e5-b226-976dbbd51728 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:26 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02d362c-7f76-49e5-b226-976dbbd51728 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea Jul 11 18:42:26 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:26 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02d362c-7f76-49e5-b226-976dbbd51728 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea" returned: 0 in 0.726s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:26 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:42:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:26 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea Jul 11 18:42:26 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (9bfbbb07-da6e-4059-bc46-3fe3efed0eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01fcf04-20c2-4bd2-b9ee-500a1353e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01fcf04-20c2-4bd2-b9ee-500a1353e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1714096473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d283a1c-ae5d-4086-a0ca-58e06155a459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:27Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4aa8612-4901-46a3-8014-6f09554a1dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4aa8612-4901-46a3-8014-6f09554a1dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93abedf-fb3f-458a-a5b0-abe7c58ad8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93abedf-fb3f-458a-a5b0-abe7c58ad8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d283a1c-ae5d-4086-a0ca-58e06155a459', 'volume_name': 'volume-8d283a1c-ae5d-4086-a0ca-58e06155a459', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6373169a-d9e8-46a3-902d-d656fa93f755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6373169a-d9e8-46a3-902d-d656fa93f755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7763780-81e7-4f65-98c2-5deda1358c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:27 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Volume 8d283a1c-ae5d-4086-a0ca-58e06155a459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d283a1c-ae5d-4086-a0ca-58e06155a459', 'volume_size': 1} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:27 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea" returned: 0 in 0.728s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:27 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.info Jul 11 18:42:27 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:28 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.info" returned: 0 in 0.675s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:28 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:28 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.info Jul 11 18:42:28 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:28 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.info" returned: 0 in 0.671s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.456s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1714096473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d283a1c-ae5d-4086-a0ca-58e06155a459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:27Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Creating volume 8d283a1c-ae5d-4086-a0ca-58e06155a459 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:28 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:42:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:28 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459 1073741824 Jul 11 18:42:28 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:29 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5defb42e-a3f0-477c-ab8c-e1872402328d tempest-GroupSnapshotsTest-685195388 None] group_snapshot 7896dd67-713b-434a-a744-942b95c8fb9f: created successfully Jul 11 18:42:30 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459 1073741824" returned: 0 in 1.185s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:30 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459 Jul 11 18:42:30 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:30 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459" returned: 0 in 0.709s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-eead09e4-65d4-485c-8042-52a65465e7ea-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" by "_create_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7763780-81e7-4f65-98c2-5deda1358c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d283a1c-ae5d-4086-a0ca-58e06155a459', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf50ba9f-2ded-4ed8-92b8-755eea1487a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:30 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Volume volume-8d283a1c-ae5d-4086-a0ca-58e06155a459 (8d283a1c-ae5d-4086-a0ca-58e06155a459): created successfully Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf50ba9f-2ded-4ed8-92b8-755eea1487a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (9bfbbb07-da6e-4059-bc46-3fe3efed0eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-eead09e4-65d4-485c-8042-52a65465e7ea-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Creating volume a4efdefd-6751-4732-90c4-cbac0d4f1cfb from snapshot eead09e4-65d4-485c-8042-52a65465e7ea {{(pid=87411) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:30 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7ef29d6a-3c73-46e2-971c-679445ec6141 tempest-VolumesActionsTest-393641591 None] Created volume successfully. Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] snapshot: eead09e4-65d4-485c-8042-52a65465e7ea, volume: a4efdefd-6751-4732-90c4-cbac0d4f1cfb, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[da063566-0da8-4c4c-8f5d-11c3b6a72418]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:31 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea Jul 11 18:42:31 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Acquiring lock "cinder-8d283a1c-ae5d-4086-a0ca-58e06155a459-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Lock "cinder-8d283a1c-ae5d-4086-a0ca-58e06155a459-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Acquiring lock "cinder-quobyte-8d283a1c-ae5d-4086-a0ca-58e06155a459" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Lock "cinder-quobyte-8d283a1c-ae5d-4086-a0ca-58e06155a459" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df2b31b-c002-4b60-8e3c-52393cbef5ab]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:31 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea" returned: 0 in 0.893s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02d362c-7f76-49e5-b226-976dbbd51728(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93b3055-7526-4801-b3dc-922fb7da02e8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:31 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459 Jul 11 18:42:31 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:31 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 Jul 11 18:42:31 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:32 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459" returned: 0 in 0.864s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:32 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728" returned: 0 in 0.833s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:32 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:42:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:32 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459 Jul 11 18:42:32 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:32 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb Jul 11 18:42:32 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:33 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8d283a1c-ae5d-4086-a0ca-58e06155a459" returned: 0 in 0.701s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Lock "cinder-quobyte-8d283a1c-ae5d-4086-a0ca-58e06155a459" released by "delete_volume" :: held 1.625s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:33 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Created reservations ['bd251cd8-e6e2-48b8-88be-ecccd69b8ec6', '95524a5d-0a26-4a19-b678-30f2e2dd3e84', '808b2fe4-9adf-4e01-afc0-43bab2d1d3c4', '6115164a-4400-402b-9524-68643bcb6722'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:33 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:42:33 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:35 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.823s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:35 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Deleted volume successfully. Jul 11 18:42:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0cd6b2b4-a9c5-456f-9c84-967552864b75 tempest-VolumesActionsTest-1526493618 None] Lock "cinder-8d283a1c-ae5d-4086-a0ca-58e06155a459-delete_volume" released by "delete_volume" :: held 3.778s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:35 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (9090da19-120a-49b9-bf46-326c21f3e8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2c90ee-1db4-42bd-90d7-c5b43981576a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2c90ee-1db4-42bd-90d7-c5b43981576a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-655964865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bb3c02-4164-4dba-abd4-58515d478d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:36Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fbe01b-789c-4ce8-bbcf-575494e24ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fbe01b-789c-4ce8-bbcf-575494e24ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e05386-6224-4c71-b28e-b87784b4dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e05386-6224-4c71-b28e-b87784b4dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09bb3c02-4164-4dba-abd4-58515d478d6f', 'volume_name': 'volume-09bb3c02-4164-4dba-abd4-58515d478d6f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ae21b-5760-4a26-9d3f-14cf216f562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ae21b-5760-4a26-9d3f-14cf216f562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8a36c7-9581-487d-b6f1-0f23bf933f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:36 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Volume 09bb3c02-4164-4dba-abd4-58515d478d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09bb3c02-4164-4dba-abd4-58515d478d6f', 'volume_size': 1} Jul 11 18:42:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:39 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" returned: 0 in 6.747s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:39 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[373733b0-ab8a-426c-a7cd-95cc709e226a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:39 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 Jul 11 18:42:39 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Acquiring lock "cinder-32612b3c-32df-482e-a598-56016a38d863-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Lock "cinder-32612b3c-32df-482e-a598-56016a38d863-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Acquiring lock "cinder-quobyte-32612b3c-32df-482e-a598-56016a38d863" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Lock "cinder-quobyte-32612b3c-32df-482e-a598-56016a38d863" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:40 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fb735e-a254-429b-abbd-01265d49f1a1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:40 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 Jul 11 18:42:40 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:40 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728" returned: 0 in 1.053s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:40 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:42:40 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Converted 1024.00 MB image at 151.75 MB/s Jul 11 18:42:40 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:42:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:40 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb Jul 11 18:42:40 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:40 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863" returned: 0 in 0.792s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:40 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863 Jul 11 18:42:40 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:41 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" returned: 0 in 0.651s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" released by "_copy_volume_from_snapshot" :: held 10.294s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-eead09e4-65d4-485c-8042-52a65465e7ea-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" released by "_create_volume_from_snapshot" :: held 10.331s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.380s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-655964865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bb3c02-4164-4dba-abd4-58515d478d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:36Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Creating volume 09bb3c02-4164-4dba-abd4-58515d478d6f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:41 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:41 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f 1073741824 Jul 11 18:42:41 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:41 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c3b05688-96f2-4df6-978e-8955b3bcebf9 tempest-GroupSnapshotsTest-685195388 None] Create group from source-snapshot-7896dd67-713b-434a-a744-942b95c8fb9f completed successfully. Jul 11 18:42:41 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-32612b3c-32df-482e-a598-56016a38d863" returned: 0 in 0.682s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Lock "cinder-quobyte-32612b3c-32df-482e-a598-56016a38d863" released by "delete_volume" :: held 1.518s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Created reservations ['e1834a1e-ceaa-4d76-8745-8b62f2497af5', '43be446e-9675-41a5-894e-029fd2a7e6ba', '7307daab-bbfc-4541-832c-5121277d1255', '0c82dcde-f0db-4c55-95dc-1f12aace4514'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:41 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:42:41 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:42 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f 1073741824" returned: 0 in 0.985s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:42 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f Jul 11 18:42:42 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" acquired by "delete_volume" :: waited 0.038s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:42 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.859s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:42 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:42 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Deleted volume successfully. Jul 11 18:42:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e635657-9472-4898-9eb4-17d47ee7bd3a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2500dd0e-2bc2-4676-8c1e-a88cd4f37b87 tempest-TaggedAttachmentsTest-502792559 None] Lock "cinder-32612b3c-32df-482e-a598-56016a38d863-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:42 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb Jul 11 18:42:42 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:43 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f" returned: 0 in 0.740s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8a36c7-9581-487d-b6f1-0f23bf933f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09bb3c02-4164-4dba-abd4-58515d478d6f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb32cc57-f27c-425f-b639-f5568fd41baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:43 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Volume volume-09bb3c02-4164-4dba-abd4-58515d478d6f (09bb3c02-4164-4dba-abd4-58515d478d6f): created successfully Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb32cc57-f27c-425f-b639-f5568fd41baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (9090da19-120a-49b9-bf46-326c21f3e8fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Acquiring lock "cinder-7f83c34d-5552-4022-9534-241c086dbd8e-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:43 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-11bbaa0b-5c04-4c84-8038-5c21cf4dab02 tempest-VolumesActionsTest-393641591 None] Created volume successfully. Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Lock "cinder-7f83c34d-5552-4022-9534-241c086dbd8e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Acquiring lock "cinder-quobyte-7f83c34d-5552-4022-9534-241c086dbd8e" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Lock "cinder-quobyte-7f83c34d-5552-4022-9534-241c086dbd8e" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1425eb66-1c20-4622-99cf-5d2a84a88564]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:43 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e Jul 11 18:42:43 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:43 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" returned: 0 in 0.959s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:43 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb Jul 11 18:42:43 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Acquiring lock "cinder-09bb3c02-4164-4dba-abd4-58515d478d6f-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Lock "cinder-09bb3c02-4164-4dba-abd4-58515d478d6f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:44 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e" returned: 0 in 0.856s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Acquiring lock "cinder-quobyte-09bb3c02-4164-4dba-abd4-58515d478d6f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:44 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e Jul 11 18:42:44 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Lock "cinder-quobyte-09bb3c02-4164-4dba-abd4-58515d478d6f" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[122f05b2-d707-4e35-b2b3-a88be9e00597]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:44 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f Jul 11 18:42:44 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:44 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" returned: 0 in 0.909s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-a4efdefd-6751-4732-90c4-cbac0d4f1cfb" released by "delete_volume" :: held 1.948s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Created reservations ['08fc902b-f947-4025-8520-00e4211b22df'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:44 devstack cinder-volume[87411]: WARNING cinder.quota [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-696376207 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-696376207, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:42:44 devstack cinder-volume[87411]: WARNING cinder.quota [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-696376207 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-696376207, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Created reservations ['c19b19d3-7ca8-46ec-bbcb-84317aade493', '2c8c7257-1b59-4cf2-ba28-6a1894dce96a', 'e78fbe65-fe86-4cec-b7b2-2ed4276f60c4', '67791b09-a9aa-4183-940b-9318caef1f71'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:44 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:42:44 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:44 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7f83c34d-5552-4022-9534-241c086dbd8e" returned: 0 in 0.788s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Lock "cinder-quobyte-7f83c34d-5552-4022-9534-241c086dbd8e" released by "delete_volume" :: held 1.710s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Created reservations ['61c41b21-6910-4ac9-b8ea-8641771c8201', '33d37404-226e-4b4f-8a4b-3f0c4903a143', 'af4042f9-2fdf-4a17-b92e-f13275a94ca6', 'b9bcba8d-0b25-4dd5-bfd7-20fa02b3da6f'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:45 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:45 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] group_snapshot 7896dd67-713b-434a-a744-942b95c8fb9f: deleting Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f" returned: 0 in 1.022s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:45 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:42:45 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] group_snapshot 7896dd67-713b-434a-a744-942b95c8fb9f: deleting {{(pid=87411) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:42:45 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f Jul 11 18:42:45 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-f02d362c-7f76-49e5-b226-976dbbd51728" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-f02d362c-7f76-49e5-b226-976dbbd51728" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-eead09e4-65d4-485c-8042-52a65465e7ea" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-eead09e4-65d4-485c-8042-52a65465e7ea" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Deleting offline snapshot eead09e4-65d4-485c-8042-52a65465e7ea of volume f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] snapshot_file for this snap is: volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5492ae3-23a7-451f-b4b0-1894d51b68a5]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:45 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea Jul 11 18:42:45 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:45 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.050s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:45 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:45 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a98ea2d6-3eea-472e-9c87-d82df4a3896b tempest-GroupSnapshotsTest-685195388 None] Delete group completed successfully. Jul 11 18:42:46 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.947s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:46 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Deleted volume successfully. Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-87a7761e-c436-4ffc-9f32-cfadaa78fd37 tempest-AttachVolumeShelveTestJSON-392332775 None] Lock "cinder-7f83c34d-5552-4022-9534-241c086dbd8e-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:46 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-09bb3c02-4164-4dba-abd4-58515d478d6f" returned: 0 in 1.184s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Lock "cinder-quobyte-09bb3c02-4164-4dba-abd4-58515d478d6f" released by "delete_volume" :: held 2.260s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Created reservations ['95064a0c-165a-4461-bda5-8646df7b8018', '4b1f6dc7-a36d-4dbf-a438-f60d46696d68', '3c949621-8f1b-4685-8a4a-acc35b272ea9', 'bb2ecf44-ce8f-4c44-97e5-d31eff343db1'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:46 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea" returned: 0 in 1.091s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02d362c-7f76-49e5-b226-976dbbd51728(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb6530c-5544-40ae-b571-6f418effc4d6]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:46 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:42:46 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:46 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 Jul 11 18:42:46 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:47 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.795s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:47 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Deleted volume successfully. Jul 11 18:42:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81340cc9-8ee9-4b94-b8c9-23f18ecf56b3 tempest-VolumesActionsTest-1526493618 None] Lock "cinder-09bb3c02-4164-4dba-abd4-58515d478d6f-delete_volume" released by "delete_volume" :: held 3.376s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:47 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728" returned: 0 in 1.008s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:47 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea Jul 11 18:42:47 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (9f44993c-679c-4f4f-8eb5-72b17a29c724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed07351b-2dd2-47e4-bd6b-254799a6fdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed07351b-2dd2-47e4-bd6b-254799a6fdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692857215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf2f797-b99e-47f7-8abe-b53a112b8a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:48Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b67f466-6777-4b25-ae50-1ac7ca485e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b67f466-6777-4b25-ae50-1ac7ca485e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7e0173-4ee0-4d51-b353-7d7da1acdd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7e0173-4ee0-4d51-b353-7d7da1acdd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf2f797-b99e-47f7-8abe-b53a112b8a70', 'volume_name': 'volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651f7849-6b2d-43ab-8755-14fa87b22517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651f7849-6b2d-43ab-8755-14fa87b22517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b468c2-d655-4b78-9857-32e6a22294ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:48 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Volume 2bf2f797-b99e-47f7-8abe-b53a112b8a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70', 'volume_size': 1} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692857215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf2f797-b99e-47f7-8abe-b53a112b8a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:48Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Creating volume 2bf2f797-b99e-47f7-8abe-b53a112b8a70 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:48 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:48 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70 1073741824 Jul 11 18:42:48 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:48 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea" returned: 0 in 1.052s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:48 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea Jul 11 18:42:48 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:49 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70 1073741824" returned: 0 in 1.024s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:49 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=84,cinder:UPDATE=98,cinder:DELETE=7,cinder:INSERT=18 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:42:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:49 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70 Jul 11 18:42:49 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:49 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728.eead09e4-65d4-485c-8042-52a65465e7ea" returned: 0 in 0.901s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-eead09e4-65d4-485c-8042-52a65465e7ea" released by "_delete_snapshot" :: held 4.184s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-f02d362c-7f76-49e5-b226-976dbbd51728" released by "delete_snapshot" :: held 4.217s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:49 devstack cinder-volume[87411]: WARNING cinder.quota [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-696376207 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-696376207, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:42:49 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] Created reservations ['59c27554-f69b-4014-8d61-deb46a8b3c7e', '95ec2c67-1e14-4b2b-97b1-c4f54fcd7d72', '03b5a87b-50e2-4651-8a0e-08038ce6c114', '9f491c93-312e-4958-9344-b5ff89e79365'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:49 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-df5a0488-d5a3-4b73-addc-2f24d67abc69 tempest-GroupSnapshotsTest-685195388 None] group_snapshot 7896dd67-713b-434a-a744-942b95c8fb9f: deleted successfully Jul 11 18:42:50 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-f02d362c-7f76-49e5-b226-976dbbd51728" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70" returned: 0 in 0.776s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-f02d362c-7f76-49e5-b226-976dbbd51728" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b468c2-d655-4b78-9857-32e6a22294ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e773cd6-d9f2-4f4b-ac36-15ac56eb53e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baa0c9b-8bed-4740-9a21-1ed69778f787]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Volume volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70 (2bf2f797-b99e-47f7-8abe-b53a112b8a70): created successfully Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e773cd6-d9f2-4f4b-ac36-15ac56eb53e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (9f44993c-679c-4f4f-8eb5-72b17a29c724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:50 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-116a7a52-e750-4a5e-97bd-bd1ad313d10a tempest-VolumesActionsTest-393641591 None] Created volume successfully. Jul 11 18:42:50 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 Jul 11 18:42:50 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:51 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728" returned: 0 in 1.015s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:51 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728 Jul 11 18:42:51 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:51 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:42:51 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Acquiring lock "cinder-2bf2f797-b99e-47f7-8abe-b53a112b8a70-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Lock "cinder-2bf2f797-b99e-47f7-8abe-b53a112b8a70-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Acquiring lock "cinder-quobyte-2bf2f797-b99e-47f7-8abe-b53a112b8a70" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Lock "cinder-quobyte-2bf2f797-b99e-47f7-8abe-b53a112b8a70" acquired by "delete_volume" :: waited 0.043s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a1e57-c4c7-4639-93a0-d8ea6d91f8bc]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:42:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:52 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70 Jul 11 18:42:52 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:52 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f02d362c-7f76-49e5-b226-976dbbd51728" returned: 0 in 1.155s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-f02d362c-7f76-49e5-b226-976dbbd51728" released by "delete_volume" :: held 2.273s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:52 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.098s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 8 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Created reservations ['8cbf961a-46dd-4b61-a351-12d721cdd2d4'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:52 devstack cinder-volume[87411]: WARNING cinder.db.api [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-696376207'] Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Created reservations ['b7387dc2-e6b8-4209-9dc8-88a52cd6a50a', 'a32e79aa-47b9-487e-825c-559b39e9e855', '60b3bf95-9196-424e-af9e-ef290ab33bec', '361dc490-ff6e-4d8b-b1c2-3c60e0e1fadd'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:52 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:42:52 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:53 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70" returned: 0 in 1.341s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:53 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70 Jul 11 18:42:53 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:54 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-971b18d0-62d9-4b92-b2c4-3e1b215a3585 tempest-GroupSnapshotsTest-685195388 None] Group tempest-GroupSnapshotsTest-Group-1566626075: creating Jul 11 18:42:54 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-971b18d0-62d9-4b92-b2c4-3e1b215a3585 tempest-GroupSnapshotsTest-685195388 None] Group tempest-GroupSnapshotsTest-Group-1566626075: created successfully Jul 11 18:42:54 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-971b18d0-62d9-4b92-b2c4-3e1b215a3585 tempest-GroupSnapshotsTest-685195388 None] Create group completed successfully. Jul 11 18:42:54 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.337s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:54 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3ad0d635-e091-4e00-8fb0-ee432be1cd57 tempest-GroupSnapshotsTest-685195388 None] Delete group completed successfully. Jul 11 18:42:54 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bf2f797-b99e-47f7-8abe-b53a112b8a70" returned: 0 in 1.046s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Lock "cinder-quobyte-2bf2f797-b99e-47f7-8abe-b53a112b8a70" released by "delete_volume" :: held 2.459s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Created reservations ['d541190a-0ac7-42ff-9dbb-5fb9c130721c', '6f139e6c-795e-4363-ad14-7338a2724433', '9a384977-bb48-4c33-9951-3ac6819cf9d5', 'b1611a77-6cd5-4e52-ab44-c9a99676467a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:54 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:42:54 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:55 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.751s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:55 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:42:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Deleted volume successfully. Jul 11 18:42:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-190ccefa-dd72-40cb-8880-0f9a8e5818df tempest-VolumesActionsTest-1526493618 None] Lock "cinder-2bf2f797-b99e-47f7-8abe-b53a112b8a70-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:42:55 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Flow 'volume_create_manager' (267fdd54-99ea-4761-a38e-8cef658172a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5da4cd-f271-4e3b-a836-05ba7f67e332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5da4cd-f271-4e3b-a836-05ba7f67e332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-37043685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcce6744-3c88-4071-9ccc-c694977362e6,host='devstack@QuobyteHD#QuobyteHD',id=b5632a0f-aedd-4f8f-a34a-672805139102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc2009b5f1143ebba9cf2e69b15b39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:56Z,use_quota=True,user_id='73c8b747ced3469894c38f3e73808d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55972af8-d78a-4272-9dc7-45d038165e00),volume_type_id=55972af8-d78a-4272-9dc7-45d038165e00)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa08b16-3fdb-45ef-b250-1a908c5f5342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa08b16-3fdb-45ef-b250-1a908c5f5342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5165ad0e-0ef7-4764-8ca5-7977fdb46bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5165ad0e-0ef7-4764-8ca5-7977fdb46bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5632a0f-aedd-4f8f-a34a-672805139102', 'volume_name': 'volume-b5632a0f-aedd-4f8f-a34a-672805139102', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b333f03e-34cf-4830-8cca-4534e3b1ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b333f03e-34cf-4830-8cca-4534e3b1ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84abccb1-a4ee-4c5b-8f62-8b1f23ccd44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Volume b5632a0f-aedd-4f8f-a34a-672805139102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5632a0f-aedd-4f8f-a34a-672805139102', 'volume_size': 1} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fcce6744-3c88-4071-9ccc-c694977362e6,created_at=2026-07-11T16:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-37043685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcce6744-3c88-4071-9ccc-c694977362e6,host='devstack@QuobyteHD#QuobyteHD',id=b5632a0f-aedd-4f8f-a34a-672805139102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc2009b5f1143ebba9cf2e69b15b39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:56Z,use_quota=True,user_id='73c8b747ced3469894c38f3e73808d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55972af8-d78a-4272-9dc7-45d038165e00),volume_type_id=55972af8-d78a-4272-9dc7-45d038165e00)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Creating volume b5632a0f-aedd-4f8f-a34a-672805139102 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:56 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:56 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 1073741824 Jul 11 18:42:56 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (f6024019-2891-4aeb-b3a3-d26687ec8166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab5ef31-d9fa-4973-8cd0-cc92d8e3d09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab5ef31-d9fa-4973-8cd0-cc92d8e3d09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-638191181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:56Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bf698e-cd5d-407c-8601-649c06570afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bf698e-cd5d-407c-8601-649c06570afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd96c7ff-9996-4cb3-a07e-5acf762b3d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd96c7ff-9996-4cb3-a07e-5acf762b3d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc', 'volume_name': 'volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3afb269-df04-406b-af25-eddd21914af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3afb269-df04-406b-af25-eddd21914af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7ecfaa-0a78-465a-8885-93d3465b9f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Volume fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc', 'volume_size': 1} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Flow 'volume_create_manager' (8f37ab68-bf0c-4a89-b1ae-9fe659d3e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a327e37-7ccd-4047-b04f-7b674fa1bdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a327e37-7ccd-4047-b04f-7b674fa1bdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-95539580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e187ec33-6828-46da-b8d6-87d30e1af3b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38d65ee0d3f44f5db7025bd6c1f20360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:57Z,use_quota=True,user_id='80f223604c85425abd271a97c8b89bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b9ba22-7028-47d4-8b57-955ca4bb8f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b9ba22-7028-47d4-8b57-955ca4bb8f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4330347-4f1f-480d-ac16-556f622ce84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4330347-4f1f-480d-ac16-556f622ce84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e187ec33-6828-46da-b8d6-87d30e1af3b2', 'volume_name': 'volume-e187ec33-6828-46da-b8d6-87d30e1af3b2', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4da4cd-4e8b-478e-be67-77908560e1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4da4cd-4e8b-478e-be67-77908560e1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada6596c-ac3e-4ed1-a7d4-823210ba973e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:57 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Volume e187ec33-6828-46da-b8d6-87d30e1af3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e187ec33-6828-46da-b8d6-87d30e1af3b2', 'volume_size': 1} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:57 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 1073741824" returned: 0 in 1.017s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:57 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 Jul 11 18:42:57 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:57 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102" returned: 0 in 0.674s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.628s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-638191181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:56Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Creating volume fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:57 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84abccb1-a4ee-4c5b-8f62-8b1f23ccd44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5632a0f-aedd-4f8f-a34a-672805139102', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:57 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc 1073741824 Jul 11 18:42:57 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c1ec27-ec84-4a56-92ef-18aeae880cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:57 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Volume volume-b5632a0f-aedd-4f8f-a34a-672805139102 (b5632a0f-aedd-4f8f-a34a-672805139102): created successfully Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c1ec27-ec84-4a56-92ef-18aeae880cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Flow 'volume_create_manager' (267fdd54-99ea-4761-a38e-8cef658172a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:57 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-422c430f-dcf9-425d-8a19-d88d79ee73d1 tempest-GroupSnapshotsTest-685195388 None] Created volume successfully. Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Flow 'volume_create_manager' (8466cfc6-2ba8-4ce3-81c8-e9cd95e39454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab04fb9-d868-457b-a6c4-9dea3c0b6675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab04fb9-d868-457b-a6c4-9dea3c0b6675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-286525194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcce6744-3c88-4071-9ccc-c694977362e6,host='devstack@QuobyteHD#QuobyteHD',id=64afb908-1f19-4ad1-a672-1e3a95582002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc2009b5f1143ebba9cf2e69b15b39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:59Z,use_quota=True,user_id='73c8b747ced3469894c38f3e73808d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55972af8-d78a-4272-9dc7-45d038165e00),volume_type_id=55972af8-d78a-4272-9dc7-45d038165e00)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b270d03-64ac-4955-8822-c42f0057e9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b270d03-64ac-4955-8822-c42f0057e9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3284fb2c-f7d7-46a3-93c3-315222374d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3284fb2c-f7d7-46a3-93c3-315222374d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64afb908-1f19-4ad1-a672-1e3a95582002', 'volume_name': 'volume-64afb908-1f19-4ad1-a672-1e3a95582002', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:58 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2768e01b-efdc-42b0-ab86-bb08f9c28ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2768e01b-efdc-42b0-ab86-bb08f9c28ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b6bf8e-7a93-4fb4-89d9-355504f190b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:58 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Volume 64afb908-1f19-4ad1-a672-1e3a95582002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64afb908-1f19-4ad1-a672-1e3a95582002', 'volume_size': 1} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc 1073741824" returned: 0 in 1.015s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:58 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc Jul 11 18:42:58 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:59 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc" returned: 0 in 0.669s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.542s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-95539580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e187ec33-6828-46da-b8d6-87d30e1af3b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38d65ee0d3f44f5db7025bd6c1f20360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:57Z,use_quota=True,user_id='80f223604c85425abd271a97c8b89bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Creating volume e187ec33-6828-46da-b8d6-87d30e1af3b2 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:42:59 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:42:59 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2 1073741824 Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7ecfaa-0a78-465a-8885-93d3465b9f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:59 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f813c83-f0ea-4690-ab1a-fd0b71d611a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:42:59 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Volume volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc (fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc): created successfully Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f813c83-f0ea-4690-ab1a-fd0b71d611a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:42:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (f6024019-2891-4aeb-b3a3-d26687ec8166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:42:59 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9b451d87-ca8a-46c2-bc08-c5205e61109a tempest-VolumesActionsTest-393641591 None] Created volume successfully. Jul 11 18:43:00 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Acquiring lock "cinder-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:00 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Lock "cinder-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:00 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Acquiring lock "cinder-quobyte-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:00 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Lock "cinder-quobyte-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:00 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d797ba68-7358-451a-bf67-f47f3ba25ef2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:00 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2 1073741824" returned: 0 in 0.974s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:00 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc Jul 11 18:43:00 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:00 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2 Jul 11 18:43:00 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:01 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc" returned: 0 in 0.809s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:01 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2" returned: 0 in 0.713s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:01 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc Jul 11 18:43:01 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.463s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fcce6744-3c88-4071-9ccc-c694977362e6,created_at=2026-07-11T16:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-286525194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcce6744-3c88-4071-9ccc-c694977362e6,host='devstack@QuobyteHD#QuobyteHD',id=64afb908-1f19-4ad1-a672-1e3a95582002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc2009b5f1143ebba9cf2e69b15b39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:42:59Z,use_quota=True,user_id='73c8b747ced3469894c38f3e73808d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55972af8-d78a-4272-9dc7-45d038165e00),volume_type_id=55972af8-d78a-4272-9dc7-45d038165e00)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Creating volume 64afb908-1f19-4ad1-a672-1e3a95582002 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:01 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada6596c-ac3e-4ed1-a7d4-823210ba973e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e187ec33-6828-46da-b8d6-87d30e1af3b2', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f089ab-113c-4126-99d4-61588cb54d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:01 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 1073741824 Jul 11 18:43:01 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:01 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Volume volume-e187ec33-6828-46da-b8d6-87d30e1af3b2 (e187ec33-6828-46da-b8d6-87d30e1af3b2): created successfully Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f089ab-113c-4126-99d4-61588cb54d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:01 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Flow 'volume_create_manager' (8f37ab68-bf0c-4a89-b1ae-9fe659d3e070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:01 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a11a3ea0-7fbc-499f-a12a-ee711604d4c8 tempest-VolumesTestJSON-1742266269 None] Created volume successfully. Jul 11 18:43:02 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc" returned: 0 in 0.838s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Lock "cinder-quobyte-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc" released by "delete_volume" :: held 1.693s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Created reservations ['3061bc7a-565c-4101-9f67-3670f743baf8', '3399926a-0335-4927-87aa-d7373e33a98a', '33838c49-95a2-4500-b2a1-24ff36c7934d', 'd58fb92d-00d3-4385-acd4-eb6b61011697'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:02 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:02 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:02 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 1073741824" returned: 0 in 1.394s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:02 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 Jul 11 18:43:02 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:03 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.917s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:03 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:03 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Deleted volume successfully. Jul 11 18:43:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ad4760b5-9794-41b1-8edb-07869a24de0f tempest-VolumesActionsTest-1526493618 None] Lock "cinder-fb18b4d2-13bb-4e25-80f2-2fd8e2f5e2bc-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:03 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002" returned: 0 in 0.870s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] <== create_volume: return (2349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b6bf8e-7a93-4fb4-89d9-355504f190b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64afb908-1f19-4ad1-a672-1e3a95582002', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097f2e92-0bdd-4884-8e2c-c218b25e05a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:03 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Volume volume-64afb908-1f19-4ad1-a672-1e3a95582002 (64afb908-1f19-4ad1-a672-1e3a95582002): created successfully Jul 11 18:43:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097f2e92-0bdd-4884-8e2c-c218b25e05a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Flow 'volume_create_manager' (8466cfc6-2ba8-4ce3-81c8-e9cd95e39454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:03 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-924528db-2c17-4f3a-bb12-775abdf5993c tempest-GroupSnapshotsTest-685195388 None] Created volume successfully. Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (983e45d0-b04f-43b5-8d43-18f46bd11de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6061a7e9-0d08-4a68-bfa0-17d0c718c9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6061a7e9-0d08-4a68-bfa0-17d0c718c9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1238888042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e579419-8af1-4d5d-9fc2-12cb00847d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:04Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1f0042-b7b5-40af-8e66-73612c698769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1f0042-b7b5-40af-8e66-73612c698769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94340f5-ab80-44e7-883b-a9e33d871142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94340f5-ab80-44e7-883b-a9e33d871142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e579419-8af1-4d5d-9fc2-12cb00847d6c', 'volume_name': 'volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edbd775-e6d9-4660-8128-bc08a3bd0c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edbd775-e6d9-4660-8128-bc08a3bd0c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4d1e05-0449-459c-aa60-d04e71c7ebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:04 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Volume 5e579419-8af1-4d5d-9fc2-12cb00847d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c', 'volume_size': 1} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1238888042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e579419-8af1-4d5d-9fc2-12cb00847d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eee2a8fc71d468d8574d181f56ee58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:04Z,use_quota=True,user_id='01fd210f274c4014bf7437a76acbd306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Creating volume 5e579419-8af1-4d5d-9fc2-12cb00847d6c {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:04 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:04 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c 1073741824 Jul 11 18:43:04 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Flow 'volume_create_manager' (46348c0c-236f-463d-9df6-5a56712b115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe31f17d-5d87-43d4-b44c-926a7c4eac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe31f17d-5d87-43d4-b44c-926a7c4eac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-226983492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28c9ed6-d038-4af5-a4e8-5275ea6e15d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38d65ee0d3f44f5db7025bd6c1f20360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:04Z,use_quota=True,user_id='80f223604c85425abd271a97c8b89bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f2f791-873d-446b-83c0-55c2f4ca94b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f2f791-873d-446b-83c0-55c2f4ca94b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a434aec8-5caa-4822-ad19-c59799131c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a434aec8-5caa-4822-ad19-c59799131c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e28c9ed6-d038-4af5-a4e8-5275ea6e15d6', 'volume_name': 'volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ae519c-6a8a-4e76-9cc7-808cd7bf5029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ae519c-6a8a-4e76-9cc7-808cd7bf5029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f8f938-d2da-4d39-88bb-1877f9770c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:04 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Volume e28c9ed6-d038-4af5-a4e8-5275ea6e15d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6', 'volume_size': 1} Jul 11 18:43:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-180a2dae-a0be-4dc7-b19e-fb82eaed8088 tempest-GroupSnapshotsTest-685195388 None] Update group completed successfully. Jul 11 18:43:05 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c 1073741824" returned: 0 in 1.038s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:05 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c Jul 11 18:43:05 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:06 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c" returned: 0 in 0.768s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.719s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-226983492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28c9ed6-d038-4af5-a4e8-5275ea6e15d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38d65ee0d3f44f5db7025bd6c1f20360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:04Z,use_quota=True,user_id='80f223604c85425abd271a97c8b89bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Creating volume e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:06 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:06 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 1073741824 Jul 11 18:43:06 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4d1e05-0449-459c-aa60-d04e71c7ebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f1df91-c5de-4f92-86f8-287f54a39bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:06 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Volume volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c (5e579419-8af1-4d5d-9fc2-12cb00847d6c): created successfully Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f1df91-c5de-4f92-86f8-287f54a39bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Flow 'volume_create_manager' (983e45d0-b04f-43b5-8d43-18f46bd11de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:06 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fc09f4ed-0ea7-400b-bd8b-72f6f06bbecb tempest-VolumesActionsTest-393641591 None] Created volume successfully. Jul 11 18:43:06 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c40e0ab1-b63d-4fa3-a69a-b026c26402af tempest-GroupSnapshotsTest-685195388 None] Update group completed successfully. Jul 11 18:43:06 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 1073741824" returned: 0 in 0.906s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:07 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 Jul 11 18:43:07 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=122,cinder:UPDATE=131,cinder:INSERT=35,cinder:DELETE=7 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:43:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2935cc3f-c7d6-4aec-91b5-091a9b8de18c tempest-GroupSnapshotsTest-685195388 None] Update group completed successfully. Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Acquiring lock "cinder-5e579419-8af1-4d5d-9fc2-12cb00847d6c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Lock "cinder-5e579419-8af1-4d5d-9fc2-12cb00847d6c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Acquiring lock "cinder-quobyte-5e579419-8af1-4d5d-9fc2-12cb00847d6c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Lock "cinder-quobyte-5e579419-8af1-4d5d-9fc2-12cb00847d6c" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[797e8d36-974a-453f-8f7c-969dee4cc44f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:07 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6" returned: 0 in 0.831s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f8f938-d2da-4d39-88bb-1877f9770c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b9fcd7-65a6-424b-b757-9ba5fd4cce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:07 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Volume volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 (e28c9ed6-d038-4af5-a4e8-5275ea6e15d6): created successfully Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b9fcd7-65a6-424b-b757-9ba5fd4cce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Flow 'volume_create_manager' (46348c0c-236f-463d-9df6-5a56712b115c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:07 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c Jul 11 18:43:07 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e360dadd-7d39-4920-993b-0765790f1b03 tempest-VolumesTestJSON-1742266269 None] Created volume successfully. Jul 11 18:43:08 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c" returned: 0 in 0.767s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:08 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c Jul 11 18:43:08 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:08 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8b553d56-86ab-4105-b8e5-decc98b23813 tempest-GroupSnapshotsTest-685195388 None] Update group completed successfully. Jul 11 18:43:09 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e579419-8af1-4d5d-9fc2-12cb00847d6c" returned: 0 in 0.770s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Lock "cinder-quobyte-5e579419-8af1-4d5d-9fc2-12cb00847d6c" released by "delete_volume" :: held 1.598s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Created reservations ['8c16a329-605a-4b46-b621-8f6bc6e629e1', '542c9c96-e9bb-4aff-b63d-96ac49a33700', 'cb1d8f48-dcb1-4c82-9d8a-75b8aabeee1d', 'acb1f0c3-758d-4b4c-9b03-f5f253fd685b'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:09 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:09 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Flow 'volume_create_manager' (87745b5d-3b69-4bfa-b838-387594fdca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083afb75-c2e6-42b4-8e64-a1453e5e4dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083afb75-c2e6-42b4-8e64-a1453e5e4dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-288204437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5575ced8-c581-48ec-93a8-f98ed5d1edd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38d65ee0d3f44f5db7025bd6c1f20360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:10Z,use_quota=True,user_id='80f223604c85425abd271a97c8b89bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cf119c-14f3-44dd-a414-e9ac6076fde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cf119c-14f3-44dd-a414-e9ac6076fde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65918e1d-1b3b-4260-8277-819c9c5c15cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65918e1d-1b3b-4260-8277-819c9c5c15cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5575ced8-c581-48ec-93a8-f98ed5d1edd9', 'volume_name': 'volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7143c6c-383f-4072-9bd9-87759ee63875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7143c6c-383f-4072-9bd9-87759ee63875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7b8bf5-8a0d-4b70-9240-c40718122e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:09 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Volume 5575ced8-c581-48ec-93a8-f98ed5d1edd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9', 'volume_size': 1} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-288204437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5575ced8-c581-48ec-93a8-f98ed5d1edd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38d65ee0d3f44f5db7025bd6c1f20360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:10Z,use_quota=True,user_id='80f223604c85425abd271a97c8b89bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Creating volume 5575ced8-c581-48ec-93a8-f98ed5d1edd9 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:09 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:09 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9 1073741824 Jul 11 18:43:09 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:10 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.795s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:10 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:10 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Deleted volume successfully. Jul 11 18:43:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6b4d27bd-7a8a-485c-a3cd-3a7fe659595e tempest-VolumesActionsTest-393641591 None] Lock "cinder-5e579419-8af1-4d5d-9fc2-12cb00847d6c-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:10 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] GroupSnapshot a08c86bd-d325-42ee-bfbe-f6848cf3439a: creating. Jul 11 18:43:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Group snapshot a08c86bd-d325-42ee-bfbe-f6848cf3439a: creating. {{(pid=87411) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:43:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:10 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9 1073741824" returned: 0 in 1.035s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:10 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9 Jul 11 18:43:10 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:11 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9" returned: 0 in 0.669s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.047s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7b8bf5-8a0d-4b70-9240-c40718122e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bea0d56-4250-4700-8d5b-d74c1027bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Creating offline snapshot 5af55809-560c-49af-a6e8-1190a97f0b95 of volume b5632a0f-aedd-4f8f-a34a-672805139102 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:43:11 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Volume volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9 (5575ced8-c581-48ec-93a8-f98ed5d1edd9): created successfully Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bea0d56-4250-4700-8d5b-d74c1027bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Flow 'volume_create_manager' (87745b5d-3b69-4bfa-b838-387594fdca76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[148a875c-e7f9-490a-996c-617f8873b348]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:11 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2f468fef-3e9f-4c92-88ac-2a12bb645132 tempest-VolumesTestJSON-1742266269 None] Created volume successfully. Jul 11 18:43:11 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 Jul 11 18:43:11 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:12 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102" returned: 0 in 0.845s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:12 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 1G Jul 11 18:43:12 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "cinder-5575ced8-c581-48ec-93a8-f98ed5d1edd9-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Lock "cinder-5575ced8-c581-48ec-93a8-f98ed5d1edd9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "cinder-quobyte-5575ced8-c581-48ec-93a8-f98ed5d1edd9" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Lock "cinder-quobyte-5575ced8-c581-48ec-93a8-f98ed5d1edd9" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04a0584-599d-49ed-a637-ad6bbca312c2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:12 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9 Jul 11 18:43:12 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:13 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 1G" returned: 0 in 0.982s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5632a0f-aedd-4f8f-a34a-672805139102 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:13 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5632a0f-aedd-4f8f-a34a-672805139102 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 Jul 11 18:43:13 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:13 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9" returned: 0 in 0.899s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:13 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9 Jul 11 18:43:13 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:14 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5632a0f-aedd-4f8f-a34a-672805139102 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95" returned: 0 in 0.774s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:14 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:14 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 Jul 11 18:43:14 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:14 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5575ced8-c581-48ec-93a8-f98ed5d1edd9" returned: 0 in 0.818s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Lock "cinder-quobyte-5575ced8-c581-48ec-93a8-f98ed5d1edd9" released by "delete_volume" :: held 1.772s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Created reservations ['e7e02867-1d51-44da-b367-7d8543b99ef7', '0a4ec09c-cce6-467b-adbd-e558dd1aa950', '689b859f-2d43-4767-bd71-6920d83417c2', '7db0e83b-6805-4dcc-8dda-10279051bac6'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:14 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:14 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "cinder-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Lock "cinder-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:15 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95" returned: 0 in 0.861s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "cinder-quobyte-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Lock "cinder-quobyte-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6" acquired by "delete_volume" :: waited 0.043s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:15 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.info Jul 11 18:43:15 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb970fb4-a66f-4962-8cc1-3cc3c81f4867]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:15 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 Jul 11 18:43:15 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:15 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.116s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Deleted volume successfully. Jul 11 18:43:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-457d1b7b-8450-450e-9938-5ed14b740c66 tempest-VolumesTestJSON-1742266269 None] Lock "cinder-5575ced8-c581-48ec-93a8-f98ed5d1edd9-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:16 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.info" returned: 0 in 1.053s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:16 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:16 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.info Jul 11 18:43:16 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:16 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6" returned: 0 in 1.099s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:16 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6 Jul 11 18:43:16 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:17 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.info" returned: 0 in 0.936s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.614s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Creating offline snapshot 96500fe5-4961-4f5c-84a8-fbf1aeacf416 of volume 64afb908-1f19-4ad1-a672-1e3a95582002 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbca242c-3ece-4e5c-a7cd-96aa82750b24]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:17 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6" returned: 0 in 0.914s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Lock "cinder-quobyte-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6" released by "delete_volume" :: held 2.085s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Created reservations ['9fe2f55f-5341-465b-a80a-9c5819441c7f', '284defe7-b473-45b0-a30c-0d08e548ec40', '3afc7a30-1f77-4150-a7bb-6ba0435d9f56', '21525e22-61e7-4aea-a391-96bfd3af4317'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:17 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 Jul 11 18:43:17 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:17 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:17 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:18 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002" returned: 0 in 0.878s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:18 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 1G Jul 11 18:43:18 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:18 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.803s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Deleted volume successfully. Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2ed4efd2-b377-478f-9059-25c50a729e37 tempest-VolumesTestJSON-1742266269 None] Lock "cinder-e28c9ed6-d038-4af5-a4e8-5275ea6e15d6-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Acquiring lock "cinder-e187ec33-6828-46da-b8d6-87d30e1af3b2-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Lock "cinder-e187ec33-6828-46da-b8d6-87d30e1af3b2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Acquiring lock "cinder-quobyte-e187ec33-6828-46da-b8d6-87d30e1af3b2" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Lock "cinder-quobyte-e187ec33-6828-46da-b8d6-87d30e1af3b2" acquired by "delete_volume" :: waited 0.029s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc652b78-7752-48ab-b6ad-fbb799658339]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:18 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2 Jul 11 18:43:18 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:19 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 1G" returned: 0 in 1.019s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64afb908-1f19-4ad1-a672-1e3a95582002 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:19 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64afb908-1f19-4ad1-a672-1e3a95582002 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 Jul 11 18:43:19 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:19 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2" returned: 0 in 0.957s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:19 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2 Jul 11 18:43:19 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:19 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64afb908-1f19-4ad1-a672-1e3a95582002 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416" returned: 0 in 0.886s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:19 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:20 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 Jul 11 18:43:20 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:20 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e187ec33-6828-46da-b8d6-87d30e1af3b2" returned: 0 in 0.739s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Lock "cinder-quobyte-e187ec33-6828-46da-b8d6-87d30e1af3b2" released by "delete_volume" :: held 1.757s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Created reservations ['f8f1eb88-fa73-4561-978c-1eff5fde7ca1', '2b4355b9-545c-4dfb-9db1-3f58d8389272', '94fa77cd-42cb-4e72-b8cb-8db9415b52ff', 'e9aa18d8-f6a9-44f4-99ce-bd731c51f1d2'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:20 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:20 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:20 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416" returned: 0 in 0.954s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:21 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.info Jul 11 18:43:21 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:21 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.124s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:21 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:21 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Deleted volume successfully. Jul 11 18:43:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-237e6da4-cbbf-4d0b-8f3c-8a44cf5cfa9d tempest-VolumesTestJSON-1742266269 None] Lock "cinder-e187ec33-6828-46da-b8d6-87d30e1af3b2-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:22 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.info" returned: 0 in 1.162s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:22 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:22 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.info Jul 11 18:43:22 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:22 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.info" returned: 0 in 0.834s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.856s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:23 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-10c05375-87ec-4a4f-b356-8dcfdeac4963 tempest-GroupSnapshotsTest-685195388 None] group_snapshot a08c86bd-d325-42ee-bfbe-f6848cf3439a: created successfully Jul 11 18:43:23 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] group_snapshot a08c86bd-d325-42ee-bfbe-f6848cf3439a: deleting Jul 11 18:43:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] group_snapshot a08c86bd-d325-42ee-bfbe-f6848cf3439a: deleting {{(pid=87411) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:43:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-b5632a0f-aedd-4f8f-a34a-672805139102" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-b5632a0f-aedd-4f8f-a34a-672805139102" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-5af55809-560c-49af-a6e8-1190a97f0b95" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-5af55809-560c-49af-a6e8-1190a97f0b95" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Deleting offline snapshot 5af55809-560c-49af-a6e8-1190a97f0b95 of volume b5632a0f-aedd-4f8f-a34a-672805139102 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:43:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] snapshot_file for this snap is: volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:43:23 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[067faf6a-7b4c-4f9d-96e9-80d31add7d28]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:23 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 Jul 11 18:43:23 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:25 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95" returned: 0 in 1.384s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5632a0f-aedd-4f8f-a34a-672805139102(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:43:25 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[590f6706-3056-444d-94b5-e27d61c7b8f7]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:25 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 Jul 11 18:43:25 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:26 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102" returned: 0 in 1.108s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:26 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 Jul 11 18:43:26 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Flow 'volume_create_manager' (6a419edc-bd47-4323-9769-12c88941f46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceeb07ef-de5e-4d59-b211-9572e61e8e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceeb07ef-de5e-4d59-b211-9572e61e8e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2052666701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a501e33-ee80-4cc1-8946-0e25ea20c0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdc0b0a499d4f87ac41f55f0f66e613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:26Z,use_quota=True,user_id='7fed6f04101b4caea313d4870ae38b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28558fc-98f4-49b0-a1c8-c3c0e82bea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28558fc-98f4-49b0-a1c8-c3c0e82bea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f2f17f-9dc0-46bb-9c6a-ba4fe3007ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f2f17f-9dc0-46bb-9c6a-ba4fe3007ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a501e33-ee80-4cc1-8946-0e25ea20c0f6', 'volume_name': 'volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b55426-9a14-471f-91bb-b683b7b1d683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b55426-9a14-471f-91bb-b683b7b1d683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278c06ff-751c-4256-ba48-5fa630d07f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:26 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Volume 9a501e33-ee80-4cc1-8946-0e25ea20c0f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6', 'volume_size': 1} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2052666701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a501e33-ee80-4cc1-8946-0e25ea20c0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdc0b0a499d4f87ac41f55f0f66e613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:26Z,use_quota=True,user_id='7fed6f04101b4caea313d4870ae38b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Creating volume 9a501e33-ee80-4cc1-8946-0e25ea20c0f6 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:26 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:26 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6 1073741824 Jul 11 18:43:26 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:27 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95" returned: 0 in 1.068s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:27 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95 Jul 11 18:43:27 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:27 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6 1073741824" returned: 0 in 1.036s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:27 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6 Jul 11 18:43:27 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ca4eee4-f4a0-4801-b847-e645d44aea3e tempest-BackendsCapabilitiesAdminTestsJSON-766364674 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87411) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 18:43:28 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102.5af55809-560c-49af-a6e8-1190a97f0b95" returned: 0 in 0.784s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-5af55809-560c-49af-a6e8-1190a97f0b95" released by "_delete_snapshot" :: held 4.504s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-b5632a0f-aedd-4f8f-a34a-672805139102" released by "delete_snapshot" :: held 4.537s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-64afb908-1f19-4ad1-a672-1e3a95582002" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-64afb908-1f19-4ad1-a672-1e3a95582002" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-96500fe5-4961-4f5c-84a8-fbf1aeacf416" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-96500fe5-4961-4f5c-84a8-fbf1aeacf416" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Deleting offline snapshot 96500fe5-4961-4f5c-84a8-fbf1aeacf416 of volume 64afb908-1f19-4ad1-a672-1e3a95582002 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] snapshot_file for this snap is: volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd007e3-b5b6-4a25-bd19-9a571d51276c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:28 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 Jul 11 18:43:28 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-114e72e5-fd8a-4290-b4cf-10d942ba7b5d tempest-BackendsCapabilitiesAdminTestsJSON-766364674 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87411) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 18:43:28 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6" returned: 0 in 0.776s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278c06ff-751c-4256-ba48-5fa630d07f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86380df0-c025-4591-95fe-d09b9e1cee03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:28 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Volume volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6 (9a501e33-ee80-4cc1-8946-0e25ea20c0f6): created successfully Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86380df0-c025-4591-95fe-d09b9e1cee03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Flow 'volume_create_manager' (6a419edc-bd47-4323-9769-12c88941f46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:28 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3c37851e-db08-40d2-a78a-c6e0f03f012c tempest-VolumesListAdminTestJSON-749615065 None] Created volume successfully. Jul 11 18:43:29 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416" returned: 0 in 0.858s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64afb908-1f19-4ad1-a672-1e3a95582002(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:43:29 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab598ea-6a32-431d-942d-3bca18a747e2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:29 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 Jul 11 18:43:29 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:30 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002" returned: 0 in 1.274s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:30 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 Jul 11 18:43:30 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Flow 'volume_create_manager' (04346fdd-efa3-4193-9038-2cce87f8fcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5e8464-81bf-4255-afd2-e2a59c088487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5e8464-81bf-4255-afd2-e2a59c088487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-320539042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af4d920-a249-4b3a-8b74-be2834947a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdc0b0a499d4f87ac41f55f0f66e613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:30Z,use_quota=True,user_id='7fed6f04101b4caea313d4870ae38b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d1700b-880c-4d1b-8fc2-2b42cdf931d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d1700b-880c-4d1b-8fc2-2b42cdf931d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38742587-7a6d-44ef-ba9b-b269f97c6b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38742587-7a6d-44ef-ba9b-b269f97c6b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af4d920-a249-4b3a-8b74-be2834947a55', 'volume_name': 'volume-8af4d920-a249-4b3a-8b74-be2834947a55', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb03861-c194-443c-b538-71f9231d3115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb03861-c194-443c-b538-71f9231d3115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ecc780-17e8-42a5-8dcb-50b5a4100691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:30 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Volume 8af4d920-a249-4b3a-8b74-be2834947a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af4d920-a249-4b3a-8b74-be2834947a55', 'volume_size': 1} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-320539042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af4d920-a249-4b3a-8b74-be2834947a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdc0b0a499d4f87ac41f55f0f66e613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:30Z,use_quota=True,user_id='7fed6f04101b4caea313d4870ae38b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Creating volume 8af4d920-a249-4b3a-8b74-be2834947a55 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:30 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:30 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55 1073741824 Jul 11 18:43:30 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:31 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416" returned: 0 in 1.107s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:31 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416 Jul 11 18:43:31 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:31 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55 1073741824" returned: 0 in 1.044s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:31 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55 Jul 11 18:43:31 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:32 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002.96500fe5-4961-4f5c-84a8-fbf1aeacf416" returned: 0 in 0.862s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-96500fe5-4961-4f5c-84a8-fbf1aeacf416" released by "_delete_snapshot" :: held 4.248s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-64afb908-1f19-4ad1-a672-1e3a95582002" released by "delete_snapshot" :: held 4.277s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:32 devstack cinder-volume[87411]: WARNING cinder.quota [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-284856634 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-284856634, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:32 devstack cinder-volume[87411]: WARNING cinder.quota [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-284856634 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-284856634, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:32 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55" returned: 0 in 0.919s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Created reservations ['68181d63-9ed9-4b0b-a8a0-5668645a61b1', '993203d7-9919-444b-b1f1-dd60428031b9', '97cc727e-a9aa-4800-a4ce-3ec31aba82e6', 'dc9e27cc-dbed-4a07-8fc3-1fc03acbfc81'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ecc780-17e8-42a5-8dcb-50b5a4100691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af4d920-a249-4b3a-8b74-be2834947a55', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28622d02-9607-4ed6-9b9c-68bb6898ce61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:32 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Volume volume-8af4d920-a249-4b3a-8b74-be2834947a55 (8af4d920-a249-4b3a-8b74-be2834947a55): created successfully Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28622d02-9607-4ed6-9b9c-68bb6898ce61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Flow 'volume_create_manager' (04346fdd-efa3-4193-9038-2cce87f8fcf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:32 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0dd2d4d7-cde3-459a-b4e9-57f33fcded08 tempest-VolumesListAdminTestJSON-749615065 None] Created volume successfully. Jul 11 18:43:32 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] Created reservations ['9337c1ac-8f03-41f3-8fcc-cd2e16fbc77f', '8458179f-df36-4071-bb15-e60047d4d93e', '9b0b64ba-17a6-4569-945e-1d6a7dcd424a', 'd462c07f-88f2-4836-adf9-8aaf67a021a4'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:32 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fd005b88-f84a-4ee1-8539-1dcf64c34f1f tempest-GroupSnapshotsTest-685195388 None] group_snapshot a08c86bd-d325-42ee-bfbe-f6848cf3439a: deleted successfully Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-64afb908-1f19-4ad1-a672-1e3a95582002" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-64afb908-1f19-4ad1-a672-1e3a95582002" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6e497e-17ef-46bd-ab78-e58d52b826e1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Flow 'volume_create_manager' (0aa2e0ec-07a7-44cb-93fd-e599f6267639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d84818-0bfd-41c0-b3bb-8d3572a8b865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d84818-0bfd-41c0-b3bb-8d3572a8b865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-643454203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e81ea17-e745-487d-a067-35c542fbd723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdc0b0a499d4f87ac41f55f0f66e613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:35Z,use_quota=True,user_id='7fed6f04101b4caea313d4870ae38b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2a8813-a1ba-489b-85c2-7de33f19fa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2a8813-a1ba-489b-85c2-7de33f19fa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa13f406-940c-430c-8186-f8539ba8c151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa13f406-940c-430c-8186-f8539ba8c151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e81ea17-e745-487d-a067-35c542fbd723', 'volume_name': 'volume-0e81ea17-e745-487d-a067-35c542fbd723', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99227077-0198-4a94-bc39-22fc49741519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99227077-0198-4a94-bc39-22fc49741519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28d70e9-be2e-40d8-b622-f7365167436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:34 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Volume 0e81ea17-e745-487d-a067-35c542fbd723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e81ea17-e745-487d-a067-35c542fbd723', 'volume_size': 1} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-643454203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e81ea17-e745-487d-a067-35c542fbd723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efdc0b0a499d4f87ac41f55f0f66e613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:35Z,use_quota=True,user_id='7fed6f04101b4caea313d4870ae38b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Creating volume 0e81ea17-e745-487d-a067-35c542fbd723 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:34 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:34 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723 1073741824 Jul 11 18:43:34 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:34 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 Jul 11 18:43:34 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:35 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002" returned: 0 in 1.161s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:35 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002 Jul 11 18:43:35 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:35 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723 1073741824" returned: 0 in 1.093s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:35 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723 Jul 11 18:43:35 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:36 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723" returned: 0 in 0.730s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c28d70e9-be2e-40d8-b622-f7365167436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e81ea17-e745-487d-a067-35c542fbd723', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a570b6-d348-4e89-aa15-9304ed89d54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:36 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Volume volume-0e81ea17-e745-487d-a067-35c542fbd723 (0e81ea17-e745-487d-a067-35c542fbd723): created successfully Jul 11 18:43:36 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a570b6-d348-4e89-aa15-9304ed89d54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Flow 'volume_create_manager' (0aa2e0ec-07a7-44cb-93fd-e599f6267639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-64afb908-1f19-4ad1-a672-1e3a95582002" returned: 0 in 0.943s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-64afb908-1f19-4ad1-a672-1e3a95582002" released by "delete_volume" :: held 2.205s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-b5632a0f-aedd-4f8f-a34a-672805139102" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-13852e82-75b2-49f0-b41f-7d180b1cfcfc tempest-VolumesListAdminTestJSON-749615065 None] Created volume successfully. Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-b5632a0f-aedd-4f8f-a34a-672805139102" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[4988af4e-8fcb-4267-93c4-e29ad40e2085]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:36 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 Jul 11 18:43:36 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:37 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102" returned: 0 in 0.781s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:37 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102 Jul 11 18:43:37 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:38 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b5632a0f-aedd-4f8f-a34a-672805139102" returned: 0 in 0.687s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-b5632a0f-aedd-4f8f-a34a-672805139102" released by "delete_volume" :: held 1.547s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Created reservations ['eaafab83-2ad1-4050-8e63-f5614ad87884'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:38 devstack cinder-volume[87411]: WARNING cinder.quota [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-284856634 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-284856634, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Created reservations ['6339c159-22b4-4e83-b327-296afd0124a6', 'f1d019e5-c931-41c0-ba3d-da8f53d911ab', 'bced0346-ed2f-41c1-81e4-f6932e48b349', 'a7bfa22f-fc77-4a57-b77a-6a20184c9730'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Created reservations ['768096f6-a472-4fb5-acdd-3b580be8e9d9', '0b1f8dce-a32d-4943-b32f-f93dfbeee478', '7cf11dc7-aab5-4e4b-9676-e15748ff8831', '6a58e5ef-61ba-4b0f-a6d1-6dabaf61d1a3'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Flow 'volume_create_manager' (8c0ecbc2-44c2-4a57-b3ea-fa65bcb28a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000b313d-4d6d-4170-ad95-e55eb4bdda14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000b313d-4d6d-4170-ad95-e55eb4bdda14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e80bf07-c61a-4ee7-848c-a9c23233b4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f2b9f6f1954aacb69821598d10d565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:39Z,use_quota=True,user_id='6da6ddfcaa6048c4978b4054691c630e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:38 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:38 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc64a0a9-74f8-4977-8f25-2033651bf883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc64a0a9-74f8-4977-8f25-2033651bf883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1032148-4f69-4900-b9de-6084b08cf221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1032148-4f69-4900-b9de-6084b08cf221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e80bf07-c61a-4ee7-848c-a9c23233b4d6', 'volume_name': 'volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f79cb71-98ca-4a90-b097-0f6f87dc57fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f79cb71-98ca-4a90-b097-0f6f87dc57fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a118095-fb28-45d0-9577-e326671c35cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:38 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Volume 8e80bf07-c61a-4ee7-848c-a9c23233b4d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6', 'volume_size': 1} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e80bf07-c61a-4ee7-848c-a9c23233b4d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f2b9f6f1954aacb69821598d10d565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:39Z,use_quota=True,user_id='6da6ddfcaa6048c4978b4054691c630e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Creating volume 8e80bf07-c61a-4ee7-848c-a9c23233b4d6 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:38 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:38 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6 1073741824 Jul 11 18:43:38 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:39 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.766s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:39 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:39 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-09f3cd8d-3166-42b9-be70-b29ad3aca187 tempest-GroupSnapshotsTest-685195388 None] Delete group completed successfully. Jul 11 18:43:39 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6 1073741824" returned: 0 in 1.026s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:39 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6 Jul 11 18:43:39 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-495cbd10-cf1f-4bf2-a43d-f41fce2e8042 tempest-GroupSnapshotsTest-685195388 None] Group tempest-GroupSnapshotsTest-Group-1275794665: creating Jul 11 18:43:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-495cbd10-cf1f-4bf2-a43d-f41fce2e8042 tempest-GroupSnapshotsTest-685195388 None] Group tempest-GroupSnapshotsTest-Group-1275794665: created successfully Jul 11 18:43:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-495cbd10-cf1f-4bf2-a43d-f41fce2e8042 tempest-GroupSnapshotsTest-685195388 None] Create group completed successfully. Jul 11 18:43:40 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6" returned: 0 in 0.718s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a118095-fb28-45d0-9577-e326671c35cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210ab0cd-8e2e-45c1-883d-d402b50f63ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:40 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Volume volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6 (8e80bf07-c61a-4ee7-848c-a9c23233b4d6): created successfully Jul 11 18:43:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210ab0cd-8e2e-45c1-883d-d402b50f63ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Flow 'volume_create_manager' (8c0ecbc2-44c2-4a57-b3ea-fa65bcb28a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ca4dc0fb-3283-4484-be79-adc31bc14414 tempest-VolumesListAdminTestJSON-455250052 None] Created volume successfully. Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Flow 'volume_create_manager' (9b8e0e12-7a93-43c8-bfdd-341ccd03b130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9231ee8-35d1-4482-889f-66b8f1684fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9231ee8-35d1-4482-889f-66b8f1684fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708454724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dde6c7fa-47bd-4a7f-a3c4-8a42b7d88167,host='devstack@QuobyteHD#QuobyteHD',id=cd08a521-1107-4ce3-b36a-a5a29f6ac79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc2009b5f1143ebba9cf2e69b15b39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:42Z,use_quota=True,user_id='73c8b747ced3469894c38f3e73808d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f41e749d-3e6f-4b1d-a7ec-c756847ffd20),volume_type_id=f41e749d-3e6f-4b1d-a7ec-c756847ffd20)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b042c8bf-a0af-4212-9319-b61601bff275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b042c8bf-a0af-4212-9319-b61601bff275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3aa130-a09f-458b-a931-f04266165534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3aa130-a09f-458b-a931-f04266165534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd08a521-1107-4ce3-b36a-a5a29f6ac79f', 'volume_name': 'volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51710cfc-e040-4008-9ab4-f83d8230683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51710cfc-e040-4008-9ab4-f83d8230683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c7c4fe-fa34-4d78-a589-fb80560d1f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:41 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Volume cd08a521-1107-4ce3-b36a-a5a29f6ac79f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f', 'volume_size': 1} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dde6c7fa-47bd-4a7f-a3c4-8a42b7d88167,created_at=2026-07-11T16:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708454724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dde6c7fa-47bd-4a7f-a3c4-8a42b7d88167,host='devstack@QuobyteHD#QuobyteHD',id=cd08a521-1107-4ce3-b36a-a5a29f6ac79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc2009b5f1143ebba9cf2e69b15b39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:42Z,use_quota=True,user_id='73c8b747ced3469894c38f3e73808d52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f41e749d-3e6f-4b1d-a7ec-c756847ffd20),volume_type_id=f41e749d-3e6f-4b1d-a7ec-c756847ffd20)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Creating volume cd08a521-1107-4ce3-b36a-a5a29f6ac79f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:41 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:41 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f 1073741824 Jul 11 18:43:41 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Acquiring lock "cinder-8e80bf07-c61a-4ee7-848c-a9c23233b4d6-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Lock "cinder-8e80bf07-c61a-4ee7-848c-a9c23233b4d6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Acquiring lock "cinder-quobyte-8e80bf07-c61a-4ee7-848c-a9c23233b4d6" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Lock "cinder-quobyte-8e80bf07-c61a-4ee7-848c-a9c23233b4d6" acquired by "delete_volume" :: waited 0.029s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "cinder-0e81ea17-e745-487d-a067-35c542fbd723-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[964dbd3f-d601-457b-9a58-15e544027e4a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-0e81ea17-e745-487d-a067-35c542fbd723-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "cinder-quobyte-0e81ea17-e745-487d-a067-35c542fbd723" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-quobyte-0e81ea17-e745-487d-a067-35c542fbd723" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[90238df5-4244-4d79-801f-49151d098740]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:42 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6 Jul 11 18:43:42 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:42 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723 Jul 11 18:43:42 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:43 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f 1073741824" returned: 0 in 1.310s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:43 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f Jul 11 18:43:43 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Flow 'volume_create_manager' (a8efbb92-45fb-43a2-9451-1589bbfb462d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffd6e9e-4fd0-4b74-b77f-3921542f354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffd6e9e-4fd0-4b74-b77f-3921542f354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1390759805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e077ae08-f043-43c6-a43f-2e2895dd0c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c04f97a00b419195a2cf57409a79e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:43Z,use_quota=True,user_id='1013166230724684ba3341ae846c5b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5163daf8-fa64-4da5-81d8-f40746497f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5163daf8-fa64-4da5-81d8-f40746497f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0951a58-1ff2-4adf-a734-d8201f6f52c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0951a58-1ff2-4adf-a734-d8201f6f52c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e077ae08-f043-43c6-a43f-2e2895dd0c23', 'volume_name': 'volume-e077ae08-f043-43c6-a43f-2e2895dd0c23', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27803df9-0154-4758-b3ed-413d62a74a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27803df9-0154-4758-b3ed-413d62a74a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f8d6f6-e105-43d2-b57e-bebca1aaecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:43 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Volume e077ae08-f043-43c6-a43f-2e2895dd0c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e077ae08-f043-43c6-a43f-2e2895dd0c23', 'volume_size': 1} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:43 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6" returned: 0 in 1.337s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:43 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723" returned: 0 in 1.182s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:43 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6 Jul 11 18:43:43 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:43 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723 Jul 11 18:43:43 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:43 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" returned: 0 in 0.804s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1390759805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e077ae08-f043-43c6-a43f-2e2895dd0c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c04f97a00b419195a2cf57409a79e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:43Z,use_quota=True,user_id='1013166230724684ba3341ae846c5b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Creating volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:43 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:43 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 1073741824 Jul 11 18:43:43 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c7c4fe-fa34-4d78-a589-fb80560d1f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81561ead-1616-4f0f-821f-8d33e5171766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:44 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Volume volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f (cd08a521-1107-4ce3-b36a-a5a29f6ac79f): created successfully Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81561ead-1616-4f0f-821f-8d33e5171766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Flow 'volume_create_manager' (9b8e0e12-7a93-43c8-bfdd-341ccd03b130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-369b684d-ebdb-497d-886e-b4ec90cc24d4 tempest-GroupSnapshotsTest-685195388 None] Created volume successfully. Jul 11 18:43:44 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8e80bf07-c61a-4ee7-848c-a9c23233b4d6" returned: 0 in 0.703s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Lock "cinder-quobyte-8e80bf07-c61a-4ee7-848c-a9c23233b4d6" released by "delete_volume" :: held 2.130s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:44 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0e81ea17-e745-487d-a067-35c542fbd723" returned: 0 in 0.743s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-quobyte-0e81ea17-e745-487d-a067-35c542fbd723" released by "delete_volume" :: held 2.013s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Created reservations ['e93db438-8f2b-49f6-9269-fe89712e294a', 'e483cff8-9414-48de-b911-822fc7d47d94', '4d447039-741f-423e-8409-4255fc4cf0a1', 'd217f527-9bc0-4105-b887-1330a03fdf3a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Created reservations ['c9c732d5-13ff-43e1-9619-eaa9cde45c3b', 'a27bd569-33f4-44c1-9356-26d422fccb68', '765135dd-bad5-47fc-897b-1b2527296701', '94dbfb71-38e9-4a07-a909-838fd91fb5da'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:44 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:44 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:44 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:44 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] GroupSnapshot 2b115fe6-ffc5-4dee-aafe-649fb16600d6: creating. Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Group snapshot 2b115fe6-ffc5-4dee-aafe-649fb16600d6: creating. {{(pid=87411) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 18:43:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:45 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 1073741824" returned: 0 in 1.146s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:45 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 Jul 11 18:43:45 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:45 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.755s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:45 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Deleted volume successfully. Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0a8147aa-efcc-4044-9e17-635344a07408 tempest-VolumesListAdminTestJSON-455250052 None] Lock "cinder-8e80bf07-c61a-4ee7-848c-a9c23233b4d6-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:45 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.814s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:45 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Deleted volume successfully. Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eba3a969-e099-468f-8355-51f2fa3f14a9 tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-0e81ea17-e745-487d-a067-35c542fbd723-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "cinder-8af4d920-a249-4b3a-8b74-be2834947a55-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-8af4d920-a249-4b3a-8b74-be2834947a55-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "cinder-quobyte-8af4d920-a249-4b3a-8b74-be2834947a55" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-quobyte-8af4d920-a249-4b3a-8b74-be2834947a55" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cde4c4-e105-42d0-bc2f-f24590f0c6f2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:45 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23" returned: 0 in 0.650s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:45 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55 Jul 11 18:43:45 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.929s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Creating offline snapshot 2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 of volume cd08a521-1107-4ce3-b36a-a5a29f6ac79f {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f8d6f6-e105-43d2-b57e-bebca1aaecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e077ae08-f043-43c6-a43f-2e2895dd0c23', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2db293e-4b50-434e-9ec2-baf49957f726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[31728ee5-dccc-4d43-ab0d-a1213c569f88]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:45 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Volume volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 (e077ae08-f043-43c6-a43f-2e2895dd0c23): created successfully Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2db293e-4b50-434e-9ec2-baf49957f726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Flow 'volume_create_manager' (a8efbb92-45fb-43a2-9451-1589bbfb462d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:45 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-adc2dffa-8dc4-4fb3-8ce0-26ee9811b6f1 tempest-SnapshotsActionsTest-534925015 None] Created volume successfully. Jul 11 18:43:45 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f Jul 11 18:43:45 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:46 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55" returned: 0 in 0.755s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:46 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55 Jul 11 18:43:46 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:46 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" returned: 0 in 0.825s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:46 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 1G Jul 11 18:43:46 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:47 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8af4d920-a249-4b3a-8b74-be2834947a55" returned: 0 in 0.669s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-quobyte-8af4d920-a249-4b3a-8b74-be2834947a55" released by "delete_volume" :: held 1.461s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Created reservations ['b0941c24-19c5-40d0-89a3-cb2c8ae13f45', '16c29397-5962-428c-a653-adb4aca008eb', '33bc09bf-6878-43e2-9f91-43e9e51902fd', '5db6ccc8-c40c-4f28-803d-78ed226ecf4d'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:47 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:47 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:47 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 1G" returned: 0 in 0.813s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:47 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 Jul 11 18:43:47 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "cinder-9a501e33-ee80-4cc1-8946-0e25ea20c0f6-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-9a501e33-ee80-4cc1-8946-0e25ea20c0f6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:47 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.716s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "cinder-quobyte-9a501e33-ee80-4cc1-8946-0e25ea20c0f6" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Deleted volume successfully. Jul 11 18:43:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-quobyte-9a501e33-ee80-4cc1-8946-0e25ea20c0f6" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c652a3-802a-4500-be7a-8a91abc1615b tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-8af4d920-a249-4b3a-8b74-be2834947a55-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8711e912-4ef8-430a-a493-561e29297a2b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:48 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6 Jul 11 18:43:48 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:48 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7" returned: 0 in 0.847s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:48 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:48 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 Jul 11 18:43:48 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Flow 'volume_create_manager' (1ac145d3-cb4a-41bd-89d7-fa406802b06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a682c1a9-e182-4427-99e2-bdf95043aae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a682c1a9-e182-4427-99e2-bdf95043aae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1876268740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e6057c-db36-47d9-bdad-dcee3c287601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5b5efe568f4f58bfcc9bb82dd34d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:49Z,use_quota=True,user_id='927fcfa015e043b796c0dfa1e4da6765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62001684-2f60-4054-953f-71563a88060f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62001684-2f60-4054-953f-71563a88060f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5505ed0a-deca-43c0-9b41-ddd400e8d10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5505ed0a-deca-43c0-9b41-ddd400e8d10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e6057c-db36-47d9-bdad-dcee3c287601', 'volume_name': 'volume-54e6057c-db36-47d9-bdad-dcee3c287601', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9ae01b-d4da-4417-b571-f33591bbf004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9ae01b-d4da-4417-b571-f33591bbf004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cba1e53-7bb1-4abe-abc2-4e58270ca546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:48 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Volume 54e6057c-db36-47d9-bdad-dcee3c287601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e6057c-db36-47d9-bdad-dcee3c287601', 'volume_size': 1} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:48 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6" returned: 0 in 0.864s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:48 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6 Jul 11 18:43:48 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:49 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7" returned: 0 in 0.835s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:49 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.info Jul 11 18:43:49 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:49 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a501e33-ee80-4cc1-8946-0e25ea20c0f6" returned: 0 in 0.802s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-quobyte-9a501e33-ee80-4cc1-8946-0e25ea20c0f6" released by "delete_volume" :: held 1.719s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=178,cinder:SELECT=147,cinder:INSERT=36,cinder:DELETE=12 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Created reservations ['890ef043-254f-450b-a43e-116de412b4ab', '7db4d8f0-c23a-41f4-b077-80ccbef6d717', '39c85f1b-48be-40b4-9d65-142c5ad38a00', '1831815b-9d40-4807-9c43-798a0e49cf0c'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:49 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:49 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:49 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.info" returned: 0 in 0.800s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:49 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:43:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:50 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.info Jul 11 18:43:50 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:50 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.747s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:50 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:50 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Deleted volume successfully. Jul 11 18:43:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2e9d44f3-da57-4a5e-a367-3685dbe96551 tempest-VolumesListAdminTestJSON-749615065 None] Lock "cinder-9a501e33-ee80-4cc1-8946-0e25ea20c0f6-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:50 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.info" returned: 0 in 0.709s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.932s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.172s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Creating offline snapshot 967f687b-12c9-469d-9c5b-1a5b7db907f4 of volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:43:50 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40264b9-d441-4379-a8d2-9d567d23b436]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:50 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ee6bfaa9-e633-4b91-8d1c-703d3f659aeb tempest-GroupSnapshotsTest-685195388 None] group_snapshot 2b115fe6-ffc5-4dee-aafe-649fb16600d6: created successfully Jul 11 18:43:50 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 Jul 11 18:43:50 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:51 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:51 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] group_snapshot 2b115fe6-ffc5-4dee-aafe-649fb16600d6: deleting Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] group_snapshot 2b115fe6-ffc5-4dee-aafe-649fb16600d6: deleting {{(pid=87411) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-2f99a6b9-56d8-456f-8463-1f3d7f9b27b7" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-2f99a6b9-56d8-456f-8463-1f3d7f9b27b7" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Deleting offline snapshot 2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 of volume cd08a521-1107-4ce3-b36a-a5a29f6ac79f {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] snapshot_file for this snap is: volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1ad512-7e29-4919-9b38-4de7ff86af7e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:51 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23" returned: 0 in 1.036s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:51 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 1G Jul 11 18:43:51 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:51 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 Jul 11 18:43:51 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:52 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.866s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:43:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 8 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:43:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:43:52 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7" returned: 0 in 1.116s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:43:52 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d647469-cc88-4bbd-82b7-59ba40397938]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:53 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f Jul 11 18:43:53 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:53 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 1G" returned: 0 in 1.238s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:53 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:43:53 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:53 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" returned: 0 in 0.975s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:53 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 Jul 11 18:43:53 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:53 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 0.933s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:53 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 is being set with open permissions: ugo+rw Jul 11 18:43:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:54 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:43:54 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:54 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 0.778s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:54 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7" returned: 0 in 0.975s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:54 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7 Jul 11 18:43:54 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:54 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.info Jul 11 18:43:54 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:55 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f.2f99a6b9-56d8-456f-8463-1f3d7f9b27b7" returned: 0 in 0.719s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:55 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.info" returned: 0 in 0.731s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:55 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.info is being set with open permissions: ugo+rw Jul 11 18:43:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-2f99a6b9-56d8-456f-8463-1f3d7f9b27b7" released by "_delete_snapshot" :: held 3.958s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" released by "delete_snapshot" :: held 4.003s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:55 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.info Jul 11 18:43:55 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:55 devstack cinder-volume[87411]: WARNING cinder.quota [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-598210851 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-598210851, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:55 devstack cinder-volume[87411]: WARNING cinder.quota [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-598210851 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-598210851, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:55 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] Created reservations ['2d1a5107-49c5-4e3d-891d-cee1a075b054', '88051d4e-562d-43bf-bf1b-c90671e8d38c', 'dc118520-ace4-49fb-b2fb-44fd340c8d13', '1770d74d-2b45-438e-9f2d-fdf00922aaea'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-13500762-95a0-48dc-a6c9-15f692317ee2 tempest-GroupSnapshotsTest-685195388 None] group_snapshot 2b115fe6-ffc5-4dee-aafe-649fb16600d6: deleted successfully Jul 11 18:43:56 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.info" returned: 0 in 0.756s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.646s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.520s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1876268740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e6057c-db36-47d9-bdad-dcee3c287601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5b5efe568f4f58bfcc9bb82dd34d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:49Z,use_quota=True,user_id='927fcfa015e043b796c0dfa1e4da6765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Creating volume 54e6057c-db36-47d9-bdad-dcee3c287601 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:43:56 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:56 devstack sudo[91937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 1073741824 Jul 11 18:43:56 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "cinder-quobyte-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:43:56 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c73ec297-fe96-42a6-a302-4abffd8717cd tempest-SnapshotsActionsTest-534925015 None] Create snapshot completed successfully Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feb8946-9097-46be-a87d-355e7d362be8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:56 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f Jul 11 18:43:56 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:57 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 1073741824" returned: 0 in 1.042s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:57 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" returned: 0 in 0.949s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:57 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 Jul 11 18:43:57 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:57 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f Jul 11 18:43:57 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:58 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601" returned: 0 in 0.805s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cba1e53-7bb1-4abe-abc2-4e58270ca546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e6057c-db36-47d9-bdad-dcee3c287601', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d38acf-0323-4d56-9b81-2a66a9dd8d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] Creating offline snapshot e0e335b0-7c8f-45e4-a6ff-cf7576301988 of volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:43:58 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Volume volume-54e6057c-db36-47d9-bdad-dcee3c287601 (54e6057c-db36-47d9-bdad-dcee3c287601): created successfully Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d38acf-0323-4d56-9b81-2a66a9dd8d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Flow 'volume_create_manager' (1ac145d3-cb4a-41bd-89d7-fa406802b06d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e7d21c-10b3-4a4e-bc8a-c6a09c9811ef]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:58 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a18a2b31-52b9-4bfa-89e6-f8b300bf2451 tempest-ServerActionsTestOtherA-1450210066 None] Created volume successfully. Jul 11 18:43:58 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" returned: 0 in 1.063s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Lock "cinder-quobyte-cd08a521-1107-4ce3-b36a-a5a29f6ac79f" released by "delete_volume" :: held 2.113s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Flow 'volume_create_manager' (e51ac8d8-fee9-4bf6-96c6-f49500d10c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:43:58 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:43:58 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e03260-0ae8-4e94-9fc4-51d98544dfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e03260-0ae8-4e94-9fc4-51d98544dfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1457988392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa92efe-b6c7-4f2e-8748-4cbd9013610c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ad4e9d13ef47ff9520d2132d7821ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:59Z,use_quota=True,user_id='4c7547242f784a89a259d241cf43b679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d73e64c-9a8d-4daf-af3f-30e0ae61dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d73e64c-9a8d-4daf-af3f-30e0ae61dae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151d5b30-4695-421d-aa56-85805054844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151d5b30-4695-421d-aa56-85805054844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa92efe-b6c7-4f2e-8748-4cbd9013610c', 'volume_name': 'volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d2c613-8b2d-4c0b-8755-8dd9cf19c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d2c613-8b2d-4c0b-8755-8dd9cf19c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3299391-94ee-4474-ba81-7c964d597085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:43:58 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Volume 6fa92efe-b6c7-4f2e-8748-4cbd9013610c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c', 'volume_size': 1} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Created reservations ['c13b4bbd-bcac-435c-806b-5f8ae4df210e'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:58 devstack cinder-volume[87411]: WARNING cinder.quota [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-598210851 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-598210851, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Created reservations ['771094df-4b78-43a2-b32f-b4b128def945', 'be523364-03ab-49bf-a81b-7f5098e54ee7', '6812f2f8-dc10-49a4-a702-b59a554aeaa8', 'c225571a-98a6-48d9-b492-0c35e8b699e8'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:43:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:58 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:43:58 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:59 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 1.008s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:43:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:43:59 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 1G Jul 11 18:43:59 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:43:59 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Jul 11 18:43:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.011s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:43:59 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:43:59 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0c342a23-9dcf-4808-884b-4708a1089051 tempest-GroupSnapshotsTest-685195388 None] Delete group completed successfully. Jul 11 18:44:00 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 1G" returned: 0 in 1.188s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:00 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 Jul 11 18:44:00 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:01 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988" returned: 0 in 0.785s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:01 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 is being set with open permissions: ugo+rw Jul 11 18:44:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:01 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 Jul 11 18:44:01 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:02 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988" returned: 0 in 0.693s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.857s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.487s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1457988392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa92efe-b6c7-4f2e-8748-4cbd9013610c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ad4e9d13ef47ff9520d2132d7821ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:43:59Z,use_quota=True,user_id='4c7547242f784a89a259d241cf43b679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Creating volume 6fa92efe-b6c7-4f2e-8748-4cbd9013610c {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:02 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:02 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c 1073741824 Jul 11 18:44:02 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:02 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-833260d7-8359-4ec4-8b9b-fc9fbfa19e8d tempest-SnapshotsActionsTest-534925015 None] Create snapshot completed successfully Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-e0e335b0-7c8f-45e4-a6ff-cf7576301988-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-e0e335b0-7c8f-45e4-a6ff-cf7576301988-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-quobyte-e0e335b0-7c8f-45e4-a6ff-cf7576301988" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-e0e335b0-7c8f-45e4-a6ff-cf7576301988" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Deleting offline snapshot e0e335b0-7c8f-45e4-a6ff-cf7576301988 of volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] snapshot_file for this snap is: volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d56b272-d40e-46c4-9af5-8bffb0d03f14]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:03 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 Jul 11 18:44:03 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:03 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c 1073741824" returned: 0 in 1.014s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:03 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c Jul 11 18:44:03 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:03 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988" returned: 0 in 0.921s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:03 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[32667675-a185-413a-a065-40c93a060d24]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:03 devstack sudo[92008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:44:03 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c" returned: 0 in 0.750s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:03 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3299391-94ee-4474-ba81-7c964d597085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b908f6c-2664-42b3-baa8-1a9d6dc698ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:04 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Volume volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c (6fa92efe-b6c7-4f2e-8748-4cbd9013610c): created successfully Jul 11 18:44:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b908f6c-2664-42b3-baa8-1a9d6dc698ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Flow 'volume_create_manager' (e51ac8d8-fee9-4bf6-96c6-f49500d10c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:04 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-647de1fb-9bc6-4d98-be57-5297ad4141db tempest-VolumesMetadataTest-1869863343 None] Created volume successfully. Jul 11 18:44:04 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 0.997s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:04 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 Jul 11 18:44:04 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-19e669ae-4dec-4547-823f-3474024303aa tempest-GroupsV320Test-2117541846 None] Group tempest-GroupsV320Test-Group-765634649: creating Jul 11 18:44:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-19e669ae-4dec-4547-823f-3474024303aa tempest-GroupsV320Test-2117541846 None] Group tempest-GroupsV320Test-Group-765634649: created successfully Jul 11 18:44:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-19e669ae-4dec-4547-823f-3474024303aa tempest-GroupsV320Test-2117541846 None] Create group completed successfully. Jul 11 18:44:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Acquiring lock "cinder-6fa92efe-b6c7-4f2e-8748-4cbd9013610c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Lock "cinder-6fa92efe-b6c7-4f2e-8748-4cbd9013610c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:05 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988" returned: 0 in 0.962s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Acquiring lock "cinder-quobyte-6fa92efe-b6c7-4f2e-8748-4cbd9013610c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:05 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988 Jul 11 18:44:05 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Lock "cinder-quobyte-6fa92efe-b6c7-4f2e-8748-4cbd9013610c" acquired by "delete_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:05 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57d8c5c-1a8b-4dd6-a3b1-9dbcb6e00218]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:06 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c Jul 11 18:44:06 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:06 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.e0e335b0-7c8f-45e4-a6ff-cf7576301988" returned: 0 in 0.863s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-e0e335b0-7c8f-45e4-a6ff-cf7576301988" released by "_delete_snapshot" :: held 3.897s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" released by "delete_snapshot" :: held 3.938s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:06 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Created reservations ['62d09bc4-d24b-44fe-a35a-818dff6bfcd9', '254df415-cb2e-4b23-a5b5-2c5d5b17f246', '88513bbb-ee27-4131-96ea-8fa81bc819c3', '6575b59e-f586-4074-abd4-5d48f81c788d'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:07 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c" returned: 0 in 1.127s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Delete snapshot completed successfully. Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-36ff47b7-63d7-467f-bac6-c9f935902ba5 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-e0e335b0-7c8f-45e4-a6ff-cf7576301988-delete_snapshot" released by "delete_snapshot" :: held 4.301s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:07 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c Jul 11 18:44:07 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-c09065af-8f11-4d36-b954-c552a16a998b tempest-GroupsV320Test-2117541846 None] Created reservations ['365338ab-3bca-4a94-b26f-c41947187b66'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c09065af-8f11-4d36-b954-c552a16a998b tempest-GroupsV320Test-2117541846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c09065af-8f11-4d36-b954-c552a16a998b tempest-GroupsV320Test-2117541846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c09065af-8f11-4d36-b954-c552a16a998b tempest-GroupsV320Test-2117541846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c09065af-8f11-4d36-b954-c552a16a998b tempest-GroupsV320Test-2117541846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c09065af-8f11-4d36-b954-c552a16a998b tempest-GroupsV320Test-2117541846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c09065af-8f11-4d36-b954-c552a16a998b tempest-GroupsV320Test-2117541846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:07 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:07 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=165,cinder:SELECT=130,cinder:INSERT=38,cinder:DELETE=12 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] Creating offline snapshot b4c3f312-6c70-4476-a616-4a34457ac181 of volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab2ac1a-1cc2-410d-8540-83259d5e2306]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:08 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:44:08 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:08 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6fa92efe-b6c7-4f2e-8748-4cbd9013610c" returned: 0 in 0.985s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Lock "cinder-quobyte-6fa92efe-b6c7-4f2e-8748-4cbd9013610c" released by "delete_volume" :: held 2.194s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Created reservations ['9ce74877-66a9-4668-9743-37b10104cf58', 'e030d977-669d-4d2d-ae86-964aedd188ec', 'bec78fd2-966e-4f16-8abb-fda81b707e2f', '232ba244-8022-46e3-8e2a-aebcf4cc9bd3'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:08 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c09065af-8f11-4d36-b954-c552a16a998b tempest-GroupsV320Test-2117541846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.117s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-c09065af-8f11-4d36-b954-c552a16a998b tempest-GroupsV320Test-2117541846 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:08 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c09065af-8f11-4d36-b954-c552a16a998b tempest-GroupsV320Test-2117541846 None] Delete group completed successfully. Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:08 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:08 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:09 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 1.342s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:09 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.812s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:09 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:09 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Deleted volume successfully. Jul 11 18:44:09 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 1G Jul 11 18:44:09 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a31475ef-4700-4147-a791-acb9e9039b64 tempest-VolumesMetadataTest-1869863343 None] Lock "cinder-6fa92efe-b6c7-4f2e-8748-4cbd9013610c-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:10 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 1G" returned: 0 in 1.160s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:10 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 Jul 11 18:44:10 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:11 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181" returned: 0 in 0.920s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:11 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 is being set with open permissions: ugo+rw Jul 11 18:44:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:11 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 Jul 11 18:44:11 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:12 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181" returned: 0 in 0.910s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.541s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:12 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3f850ebb-9b0a-4f35-a261-0424d57328cf tempest-SnapshotsActionsTest-534925015 None] Create snapshot completed successfully Jul 11 18:44:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-b4c3f312-6c70-4476-a616-4a34457ac181-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-b4c3f312-6c70-4476-a616-4a34457ac181-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-quobyte-b4c3f312-6c70-4476-a616-4a34457ac181" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-b4c3f312-6c70-4476-a616-4a34457ac181" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Deleting offline snapshot b4c3f312-6c70-4476-a616-4a34457ac181 of volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:44:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] snapshot_file for this snap is: volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:44:13 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8482779-9947-49bc-bddf-38ec0880098f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:13 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 Jul 11 18:44:13 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:14 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181" returned: 0 in 0.913s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:14 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab4903a-39b9-461d-80ce-bf105a11b622]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:14 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:44:14 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:15 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 1.038s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:15 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 Jul 11 18:44:15 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:16 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181" returned: 0 in 1.007s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:16 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181 Jul 11 18:44:16 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Flow 'volume_create_manager' (aba846f6-7f86-43b3-a170-7ecc235afb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e901f32e-e97c-4cb8-bdf4-126930b94e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e901f32e-e97c-4cb8-bdf4-126930b94e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-276509032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98190e5-1939-4204-a0ac-579c637cef35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581311b71b8c4ca49ff1b00cd45db152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:17Z,use_quota=True,user_id='6ddd3ba480ee4abb981a6e1f66201311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9074b1cd-a12f-4d43-94b3-c1fbb234cfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9074b1cd-a12f-4d43-94b3-c1fbb234cfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b76373-55a9-4dfb-a436-3410c4ed5bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b76373-55a9-4dfb-a436-3410c4ed5bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98190e5-1939-4204-a0ac-579c637cef35', 'volume_name': 'volume-e98190e5-1939-4204-a0ac-579c637cef35', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99af88eb-8f89-4d67-8b6e-7cd0499f2081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99af88eb-8f89-4d67-8b6e-7cd0499f2081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be230e8-bd56-4bdd-bbf2-259a312c88c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:16 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Volume e98190e5-1939-4204-a0ac-579c637cef35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98190e5-1939-4204-a0ac-579c637cef35', 'volume_size': 1} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-276509032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98190e5-1939-4204-a0ac-579c637cef35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581311b71b8c4ca49ff1b00cd45db152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:17Z,use_quota=True,user_id='6ddd3ba480ee4abb981a6e1f66201311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Creating volume e98190e5-1939-4204-a0ac-579c637cef35 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:16 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:44:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:16 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35 1073741824 Jul 11 18:44:16 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:17 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.b4c3f312-6c70-4476-a616-4a34457ac181" returned: 0 in 0.761s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-b4c3f312-6c70-4476-a616-4a34457ac181" released by "_delete_snapshot" :: held 3.881s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" released by "delete_snapshot" :: held 3.928s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:17 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Created reservations ['59fe77ba-7397-49e5-9b8b-732eb20e3a7c', '202eee0f-0a30-40c7-95c0-9d3c0849479d', 'acf00862-38e2-4b69-a225-eaf2eb886014', 'b4c02114-166f-436c-967e-9fead2ee6faf'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Delete snapshot completed successfully. Jul 11 18:44:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3cf78f07-0ae2-4e02-a1ee-a8b1db386a12 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-b4c3f312-6c70-4476-a616-4a34457ac181-delete_snapshot" released by "delete_snapshot" :: held 4.134s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:17 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35 1073741824" returned: 0 in 1.128s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:18 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35 Jul 11 18:44:18 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:18 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35" returned: 0 in 0.678s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.696s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be230e8-bd56-4bdd-bbf2-259a312c88c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98190e5-1939-4204-a0ac-579c637cef35', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceff5694-fba9-4e10-a989-91fe0f827ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] Creating offline snapshot 866d3815-c5c4-42cc-9797-54f9bfdcf75b of volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:44:18 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Volume volume-e98190e5-1939-4204-a0ac-579c637cef35 (e98190e5-1939-4204-a0ac-579c637cef35): created successfully Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceff5694-fba9-4e10-a989-91fe0f827ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Flow 'volume_create_manager' (aba846f6-7f86-43b3-a170-7ecc235afb57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a12fe9c-7a44-4d3a-b5b6-a586d918cbae]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-67f54243-ca63-4841-9dcd-79e3c096e6aa tempest-VolumesTransfersV355Test-870366943 None] Created volume successfully. Jul 11 18:44:18 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:44:18 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:19 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 0.897s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:19 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b 1G Jul 11 18:44:19 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:20 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b 1G" returned: 0 in 1.087s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6f699e9c-b1cd-468e-8e13-273af21d6493 tempest-VolumesTransfersV355Test-573634877 None] Transfer volume completed successfully. Jul 11 18:44:20 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b Jul 11 18:44:20 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:21 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b" returned: 0 in 0.736s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:21 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b is being set with open permissions: ugo+rw Jul 11 18:44:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:21 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b Jul 11 18:44:21 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Acquiring lock "cinder-e98190e5-1939-4204-a0ac-579c637cef35-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Lock "cinder-e98190e5-1939-4204-a0ac-579c637cef35-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Acquiring lock "cinder-quobyte-e98190e5-1939-4204-a0ac-579c637cef35" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Lock "cinder-quobyte-e98190e5-1939-4204-a0ac-579c637cef35" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:22 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a5391f-1a72-44f1-8e89-e5bdf2deb2a2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:22 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b" returned: 0 in 0.691s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:22 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35 Jul 11 18:44:22 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.596s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:22 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-98e557af-3464-4457-b49d-3500f95175d1 tempest-SnapshotsActionsTest-534925015 None] Create snapshot completed successfully Jul 11 18:44:22 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35" returned: 0 in 0.775s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:22 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35 Jul 11 18:44:22 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-866d3815-c5c4-42cc-9797-54f9bfdcf75b-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-866d3815-c5c4-42cc-9797-54f9bfdcf75b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Flow 'volume_create_manager' (bb47ba76-3996-4076-9aaf-8649165a4b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c190a6c-dbdc-471c-a426-299d93521e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-quobyte-866d3815-c5c4-42cc-9797-54f9bfdcf75b" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c190a6c-dbdc-471c-a426-299d93521e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1450086294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529deaf8-32f2-4f15-a1e2-261e4b406d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a7f52fd1b8429d9aaefa65385791c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:23Z,use_quota=True,user_id='95521c4283c941329f31f58fb885576c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39069dde-b52b-4c8f-8c9b-ff6edb244fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39069dde-b52b-4c8f-8c9b-ff6edb244fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd19681-c2d4-4fa9-bd00-ce9f613760c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd19681-c2d4-4fa9-bd00-ce9f613760c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529deaf8-32f2-4f15-a1e2-261e4b406d77', 'volume_name': 'volume-529deaf8-32f2-4f15-a1e2-261e4b406d77', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cb8c92-43a1-48ff-b779-93df7a1e523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cb8c92-43a1-48ff-b779-93df7a1e523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80c6a9a-9770-4e58-94e6-dc0c331c7206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:23 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Volume 529deaf8-32f2-4f15-a1e2-261e4b406d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529deaf8-32f2-4f15-a1e2-261e4b406d77', 'volume_size': 1} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1450086294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529deaf8-32f2-4f15-a1e2-261e4b406d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a7f52fd1b8429d9aaefa65385791c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:23Z,use_quota=True,user_id='95521c4283c941329f31f58fb885576c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Creating volume 529deaf8-32f2-4f15-a1e2-261e4b406d77 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:23 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-866d3815-c5c4-42cc-9797-54f9bfdcf75b" acquired by "_delete_snapshot" :: waited 0.083s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:23 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77 1073741824 Jul 11 18:44:23 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Deleting offline snapshot 866d3815-c5c4-42cc-9797-54f9bfdcf75b of volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] snapshot_file for this snap is: volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[21335e01-8ad5-4be9-a663-650cb303a58b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:23 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e98190e5-1939-4204-a0ac-579c637cef35" returned: 0 in 0.690s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Lock "cinder-quobyte-e98190e5-1939-4204-a0ac-579c637cef35" released by "delete_volume" :: held 1.517s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Created reservations ['67a191dd-0beb-4345-9355-7d214189da57', 'ef5b0006-c8fd-486d-a0f5-35078ff006d8', 'c10ee1df-5bac-44ec-84c9-2686ea51d264', 'b6fb7fa4-dded-40fa-a998-f201f902b79a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:23 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b Jul 11 18:44:23 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:23 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:23 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:24 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b" returned: 0 in 0.852s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:24 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.714s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Deleted volume successfully. Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8507878-18af-4b56-a15a-1ae6fbbdd85f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:24 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77 1073741824" returned: 0 in 0.977s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-affc5588-4fb7-44f8-8e23-8a130edc79d0 tempest-VolumesTransfersV355Test-1279140425 None] Lock "cinder-e98190e5-1939-4204-a0ac-579c637cef35-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:24 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77 Jul 11 18:44:24 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:24 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:44:24 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Flow 'volume_create_manager' (152c1e65-87ff-4d29-af4b-c895d00645dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c442ac-75d1-4779-abc5-d84e56aae524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c442ac-75d1-4779-abc5-d84e56aae524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-881927021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d748134a-2b46-4998-9e59-4e09f4b3af6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581311b71b8c4ca49ff1b00cd45db152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:25Z,use_quota=True,user_id='6ddd3ba480ee4abb981a6e1f66201311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7053c5bc-2444-4e05-b320-3869994601c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7053c5bc-2444-4e05-b320-3869994601c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2317b1f1-5799-4304-97a1-52f67b2eb1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2317b1f1-5799-4304-97a1-52f67b2eb1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd748134a-2b46-4998-9e59-4e09f4b3af6c', 'volume_name': 'volume-d748134a-2b46-4998-9e59-4e09f4b3af6c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaae60f5-c00f-488c-8834-8c344a53f1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaae60f5-c00f-488c-8834-8c344a53f1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f807a0-161b-4a65-b7b3-2fa5387bce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:24 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Volume d748134a-2b46-4998-9e59-4e09f4b3af6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d748134a-2b46-4998-9e59-4e09f4b3af6c', 'volume_size': 1} Jul 11 18:44:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:25 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77" returned: 0 in 0.659s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-881927021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d748134a-2b46-4998-9e59-4e09f4b3af6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581311b71b8c4ca49ff1b00cd45db152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:25Z,use_quota=True,user_id='6ddd3ba480ee4abb981a6e1f66201311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Creating volume d748134a-2b46-4998-9e59-4e09f4b3af6c {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:25 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80c6a9a-9770-4e58-94e6-dc0c331c7206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529deaf8-32f2-4f15-a1e2-261e4b406d77', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:25 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c 1073741824 Jul 11 18:44:25 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378678d8-9d54-4e4f-9e70-af8d254c0810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:25 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Volume volume-529deaf8-32f2-4f15-a1e2-261e4b406d77 (529deaf8-32f2-4f15-a1e2-261e4b406d77): created successfully Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378678d8-9d54-4e4f-9e70-af8d254c0810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Flow 'volume_create_manager' (bb47ba76-3996-4076-9aaf-8649165a4b13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:25 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 0.794s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:25 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8876be74-b6df-4e83-95b2-30b390e7ba97 tempest-VolumeQuotasNegativeTestJSON-635927563 None] Created volume successfully. Jul 11 18:44:25 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b Jul 11 18:44:25 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:26 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c 1073741824" returned: 0 in 0.891s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:26 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b" returned: 0 in 0.898s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:26 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c Jul 11 18:44:26 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:26 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b Jul 11 18:44:26 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Acquiring lock "cinder-529deaf8-32f2-4f15-a1e2-261e4b406d77-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Lock "cinder-529deaf8-32f2-4f15-a1e2-261e4b406d77-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Acquiring lock "cinder-quobyte-529deaf8-32f2-4f15-a1e2-261e4b406d77" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Lock "cinder-quobyte-529deaf8-32f2-4f15-a1e2-261e4b406d77" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8b2f92-a482-4550-8d15-0b8351d9f4c4]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:26 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c" returned: 0 in 0.736s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:26 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77 Jul 11 18:44:26 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f807a0-161b-4a65-b7b3-2fa5387bce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d748134a-2b46-4998-9e59-4e09f4b3af6c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24babaff-fa55-40c9-84aa-2882cea255f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:26 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Volume volume-d748134a-2b46-4998-9e59-4e09f4b3af6c (d748134a-2b46-4998-9e59-4e09f4b3af6c): created successfully Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24babaff-fa55-40c9-84aa-2882cea255f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Flow 'volume_create_manager' (152c1e65-87ff-4d29-af4b-c895d00645dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:26 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.866d3815-c5c4-42cc-9797-54f9bfdcf75b" returned: 0 in 0.774s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-866d3815-c5c4-42cc-9797-54f9bfdcf75b" released by "_delete_snapshot" :: held 3.446s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:27 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8643b3a6-4738-4d8a-9a6d-6a0a132b53a8 tempest-VolumesTransfersV355Test-870366943 None] Created volume successfully. Jul 11 18:44:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" released by "delete_snapshot" :: held 3.542s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:27 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Created reservations ['f253fa13-c923-4f0f-81af-fb7f1640b5e6', '10949d7b-38c9-469b-8882-b8b06d8865e7', '3318f116-3f15-4ecf-bdd2-d37fa9eb7bd2', '577ba3e1-ef71-444f-b249-9ed88b36bf50'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:27 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Delete snapshot completed successfully. Jul 11 18:44:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9b4407f4-50e5-4227-a1a1-c800d4417ecb tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-866d3815-c5c4-42cc-9797-54f9bfdcf75b-delete_snapshot" released by "delete_snapshot" :: held 3.739s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:27 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77" returned: 0 in 0.858s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:27 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77 Jul 11 18:44:27 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] Creating offline snapshot a60f4068-5190-44b4-9d88-e9018df767f3 of volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d38ce6-77ac-46e5-a535-90b021f3c918]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:28 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:44:28 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Acquiring lock "cinder-d748134a-2b46-4998-9e59-4e09f4b3af6c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Lock "cinder-d748134a-2b46-4998-9e59-4e09f4b3af6c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:28 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-529deaf8-32f2-4f15-a1e2-261e4b406d77" returned: 0 in 0.877s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Lock "cinder-quobyte-529deaf8-32f2-4f15-a1e2-261e4b406d77" released by "delete_volume" :: held 1.800s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Acquiring lock "cinder-quobyte-d748134a-2b46-4998-9e59-4e09f4b3af6c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Lock "cinder-quobyte-d748134a-2b46-4998-9e59-4e09f4b3af6c" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18fcd8a-a467-4728-9ab9-fe8d38690100]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Created reservations ['ec71b435-3570-40a1-865d-6d1af575aa7d', '4d119291-9519-4a8f-963f-913f6d71a47c', '71ccbf6b-03e3-4f3c-8dbb-1d53139482f1', 'b9160617-d841-45c7-8ed2-0cf0f9633c2b'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:28 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c Jul 11 18:44:28 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:28 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:28 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:29 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 1.071s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:29 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 1G Jul 11 18:44:29 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:29 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.786s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:29 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:29 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Deleted volume successfully. Jul 11 18:44:29 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc1e93ca-3b8b-40da-9d00-d6999d26369e tempest-VolumeQuotasNegativeTestJSON-635927563 None] Lock "cinder-529deaf8-32f2-4f15-a1e2-261e4b406d77-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:29 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c" returned: 0 in 0.969s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:29 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c Jul 11 18:44:29 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:30 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d748134a-2b46-4998-9e59-4e09f4b3af6c" returned: 0 in 0.793s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:30 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Lock "cinder-quobyte-d748134a-2b46-4998-9e59-4e09f4b3af6c" released by "delete_volume" :: held 1.823s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 1G" returned: 0 in 1.146s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:30 devstack sudo[92272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 Jul 11 18:44:30 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Created reservations ['109e5cfa-8939-4282-a125-81f522841e47', '1ec1989d-5cf3-46a0-a6ab-be0224fed54f', '81bd4997-df7a-4aef-b566-30fbdbb275c4', 'bfb1b496-bfe0-4a59-bb5f-5cce6cd9338f'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:30 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:30 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:31 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3" returned: 0 in 0.836s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:31 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 is being set with open permissions: ugo+rw Jul 11 18:44:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:31 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 Jul 11 18:44:31 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:31 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.880s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:31 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:31 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Deleted volume successfully. Jul 11 18:44:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cfc88e4-b5b7-4e7b-ae33-04ecffccac1e tempest-VolumesTransfersV355Test-1279140425 None] Lock "cinder-d748134a-2b46-4998-9e59-4e09f4b3af6c-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:32 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3" returned: 0 in 0.823s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.043s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:32 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8bc3b942-6fb5-435f-9eb8-87d53885b4ad tempest-SnapshotsActionsTest-534925015 None] Create snapshot completed successfully Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-a60f4068-5190-44b4-9d88-e9018df767f3-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-a60f4068-5190-44b4-9d88-e9018df767f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Acquiring lock "cinder-quobyte-a60f4068-5190-44b4-9d88-e9018df767f3" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-a60f4068-5190-44b4-9d88-e9018df767f3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Deleting offline snapshot a60f4068-5190-44b4-9d88-e9018df767f3 of volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] snapshot_file for this snap is: volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a40ad4-919f-4f5f-aedd-0bceb66d21cf]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:32 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 Jul 11 18:44:32 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:33 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3" returned: 0 in 0.947s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:33 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd7fedb-9cb7-4e5a-8894-a0b886e87f6e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:33 devstack sudo[92294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:44:33 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:34 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 0.794s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:34 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 Jul 11 18:44:34 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:35 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3" returned: 0 in 0.950s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:35 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3 Jul 11 18:44:35 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Flow 'volume_create_manager' (f5cdb951-4895-48b9-aa95-94830a98de09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac20b50c-5ebc-4ce6-9b9e-a52b3bf308f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:36 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.a60f4068-5190-44b4-9d88-e9018df767f3" returned: 0 in 0.768s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac20b50c-5ebc-4ce6-9b9e-a52b3bf308f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-609553180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aabeff0-3a78-464c-9541-6235a67674a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4bf9abe3f19480ab77f7f468a3910db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:36Z,use_quota=True,user_id='73ccd0bec1ce4845ae43475757f10564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffc2e503-c253-43a8-ab4c-f053754edb65),volume_type_id=ffc2e503-c253-43a8-ab4c-f053754edb65)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6e60a7-4708-4b0e-b48c-003e3d248a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6e60a7-4708-4b0e-b48c-003e3d248a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e81dfc-03e2-40b3-b385-2bcb87d361a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e81dfc-03e2-40b3-b385-2bcb87d361a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aabeff0-3a78-464c-9541-6235a67674a5', 'volume_name': 'volume-2aabeff0-3a78-464c-9541-6235a67674a5', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8ad051-d602-4c39-acd7-51939cc4bc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8ad051-d602-4c39-acd7-51939cc4bc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d2bb2d-466b-41ba-b715-d8031f0cd972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:36 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Volume 2aabeff0-3a78-464c-9541-6235a67674a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aabeff0-3a78-464c-9541-6235a67674a5', 'volume_size': 1} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-609553180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aabeff0-3a78-464c-9541-6235a67674a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4bf9abe3f19480ab77f7f468a3910db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:36Z,use_quota=True,user_id='73ccd0bec1ce4845ae43475757f10564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffc2e503-c253-43a8-ab4c-f053754edb65),volume_type_id=ffc2e503-c253-43a8-ab4c-f053754edb65)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Creating volume 2aabeff0-3a78-464c-9541-6235a67674a5 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:36 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-a60f4068-5190-44b4-9d88-e9018df767f3" released by "_delete_snapshot" :: held 3.659s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-6e1047cc-64f3-4459-8823-b17c11222e3b req-262a9646-aa0d-4093-890a-9bde9c8ebf1b tempest-ServerActionsTestOtherA-1450210066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" released by "delete_snapshot" :: held 3.692s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:36 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5 1073741824 Jul 11 18:44:36 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Created reservations ['62313929-76a0-4bd2-aebb-a0101a5ad827', '9314de21-6ed9-49c6-b7e7-d94c5198699b', '8b00be35-8263-4813-862d-8065f5876624', 'fe58f836-ba84-4451-be78-f7f20be2e2f5'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Delete snapshot completed successfully. Jul 11 18:44:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3bb5a8df-d947-476a-a0ee-08efede752c3 tempest-SnapshotsActionsTest-176719511 None] Lock "cinder-a60f4068-5190-44b4-9d88-e9018df767f3-delete_snapshot" released by "delete_snapshot" :: held 3.834s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:37 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5 1073741824" returned: 0 in 0.935s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:37 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5 Jul 11 18:44:37 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "cinder-967f687b-12c9-469d-9c5b-1a5b7db907f4-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Lock "cinder-967f687b-12c9-469d-9c5b-1a5b7db907f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "cinder-quobyte-967f687b-12c9-469d-9c5b-1a5b7db907f4" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Lock "cinder-quobyte-967f687b-12c9-469d-9c5b-1a5b7db907f4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Deleting offline snapshot 967f687b-12c9-469d-9c5b-1a5b7db907f4 of volume e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] snapshot_file for this snap is: volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69a403b-5da5-4ad6-8d00-40d26d26db16]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:37 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:44:37 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:37 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5" returned: 0 in 0.693s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-6e1047cc-64f3-4459-8823-b17c11222e3b req-262a9646-aa0d-4093-890a-9bde9c8ebf1b tempest-ServerActionsTestOtherA-1450210066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.648s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d2bb2d-466b-41ba-b715-d8031f0cd972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aabeff0-3a78-464c-9541-6235a67674a5', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706ad1cc-d030-4b7a-befc-9a468dcda4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f73dea4-4b64-4fc8-b417-14df0bea866e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-6e1047cc-64f3-4459-8823-b17c11222e3b req-262a9646-aa0d-4093-890a-9bde9c8ebf1b tempest-ServerActionsTestOtherA-1450210066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:37 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Volume volume-2aabeff0-3a78-464c-9541-6235a67674a5 (2aabeff0-3a78-464c-9541-6235a67674a5): created successfully Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706ad1cc-d030-4b7a-befc-9a468dcda4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Flow 'volume_create_manager' (f5cdb951-4895-48b9-aa95-94830a98de09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:37 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b7873ea9-7c27-40e3-97ea-73aefe351854 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Created volume successfully. Jul 11 18:44:37 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 Jul 11 18:44:37 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:38 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 0.803s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e077ae08-f043-43c6-a43f-2e2895dd0c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c909ec91-301c-4bf4-8a34-383de8b09286]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:38 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 Jul 11 18:44:38 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Flow 'volume_create_manager' (7be47674-7e83-4c20-800b-f536d4254c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55c50bb-3c88-4f7d-8928-7658a9108d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:38 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-6e1047cc-64f3-4459-8823-b17c11222e3b req-262a9646-aa0d-4093-890a-9bde9c8ebf1b tempest-ServerActionsTestOtherA-1450210066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601" returned: 0 in 0.834s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-6e1047cc-64f3-4459-8823-b17c11222e3b req-262a9646-aa0d-4093-890a-9bde9c8ebf1b tempest-ServerActionsTestOtherA-1450210066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.866s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55c50bb-3c88-4f7d-8928-7658a9108d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1971297665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2c63249c234e6f9f7c453451bb0672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:39Z,use_quota=True,user_id='b551b458a69b441d9af89be554a5933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da3ee5f-b5e2-406d-bf64-fca5ef05f47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da3ee5f-b5e2-406d-bf64-fca5ef05f47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acb6d0d-b9c4-4d1b-83eb-38b1a8fb9fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acb6d0d-b9c4-4d1b-83eb-38b1a8fb9fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906', 'volume_name': 'volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f006be-f17c-4903-8c79-b50c13afe91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f006be-f17c-4903-8c79-b50c13afe91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cfd222-593d-41c9-943d-f552e89aeb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:38 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Volume 2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906', 'volume_size': 1} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1971297665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2c63249c234e6f9f7c453451bb0672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:39Z,use_quota=True,user_id='b551b458a69b441d9af89be554a5933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Creating volume 2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:38 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:38 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 1073741824 Jul 11 18:44:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-6e1047cc-64f3-4459-8823-b17c11222e3b req-262a9646-aa0d-4093-890a-9bde9c8ebf1b tempest-ServerActionsTestOtherA-1450210066 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-54e6057c-db36-47d9-bdad-dcee3c287601', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f18561b6-6eb0-456f-8b10-a6b1f4780032', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:44:38 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-6e1047cc-64f3-4459-8823-b17c11222e3b req-262a9646-aa0d-4093-890a-9bde9c8ebf1b tempest-ServerActionsTestOtherA-1450210066 None] attachment_update completed successfully. Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-36b67172-666a-45c7-9355-9955866375b3 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-36b67172-666a-45c7-9355-9955866375b3 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-36b67172-666a-45c7-9355-9955866375b3 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-36b67172-666a-45c7-9355-9955866375b3 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-36b67172-666a-45c7-9355-9955866375b3 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-36b67172-666a-45c7-9355-9955866375b3 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:39 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23" returned: 0 in 0.958s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:39 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:39 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:39 devstack sudo[92349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:44:39 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:39 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 1073741824" returned: 0 in 0.964s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:39 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 Jul 11 18:44:39 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:39 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-36b67172-666a-45c7-9355-9955866375b3 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.731s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-36b67172-666a-45c7-9355-9955866375b3 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:39 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-36b67172-666a-45c7-9355-9955866375b3 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Retype volume completed successfully. Jul 11 18:44:39 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 0.907s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:40 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4 Jul 11 18:44:40 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Acquiring lock "cinder-2aabeff0-3a78-464c-9541-6235a67674a5-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "cinder-2aabeff0-3a78-464c-9541-6235a67674a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:40 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906" returned: 0 in 0.724s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cfd222-593d-41c9-943d-f552e89aeb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94406b19-d5e7-4383-9658-41f617d17dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:40 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Volume volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 (2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906): created successfully Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94406b19-d5e7-4383-9658-41f617d17dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Flow 'volume_create_manager' (7be47674-7e83-4c20-800b-f536d4254c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Acquiring lock "cinder-quobyte-2aabeff0-3a78-464c-9541-6235a67674a5" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-23a765ab-2366-47f8-9916-200b11216eaf tempest-VolumesTransfersV357Test-29632842 None] Created volume successfully. Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "cinder-quobyte-2aabeff0-3a78-464c-9541-6235a67674a5" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdf4e21-b4c5-4076-9ea9-8476b93c4e1e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:40 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5 Jul 11 18:44:40 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:40 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23.967f687b-12c9-469d-9c5b-1a5b7db907f4" returned: 0 in 0.729s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Lock "cinder-quobyte-967f687b-12c9-469d-9c5b-1a5b7db907f4" released by "_delete_snapshot" :: held 3.528s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" released by "delete_snapshot" :: held 3.550s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Created reservations ['9ae0fd24-4e6f-4899-ad1b-564979dd963d', '26eb3933-be0f-42df-b3cb-6daab48d77ac', '49b43d37-2135-4060-b15b-e5a9eeb45aca', '0849c68e-0d44-4a5e-955a-ef7d6c477931'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Delete snapshot completed successfully. Jul 11 18:44:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-318df5f4-1ad0-4185-92b2-4c6561519f6e tempest-SnapshotsActionsTest-534925015 None] Lock "cinder-967f687b-12c9-469d-9c5b-1a5b7db907f4-delete_snapshot" released by "delete_snapshot" :: held 3.721s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:41 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5" returned: 0 in 0.831s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:41 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5 Jul 11 18:44:41 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:41 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6c485b2f-4804-44b2-8625-39e947f461ee tempest-VolumesTransfersV357Test-124364820 None] Transfer volume completed successfully. Jul 11 18:44:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "cinder-e077ae08-f043-43c6-a43f-2e2895dd0c23-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Lock "cinder-e077ae08-f043-43c6-a43f-2e2895dd0c23-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:41 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9850fa40-7127-4642-8488-54a5b3ce6dff]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:41 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 Jul 11 18:44:41 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:42 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aabeff0-3a78-464c-9541-6235a67674a5" returned: 0 in 0.697s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "cinder-quobyte-2aabeff0-3a78-464c-9541-6235a67674a5" released by "delete_volume" :: held 1.572s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:42 devstack cinder-volume[87411]: WARNING cinder.quota [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:44:42 devstack cinder-volume[87411]: WARNING cinder.quota [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Created reservations ['37acae3e-f1c3-4df0-a7b2-74020ec6c4e9', '5a7da672-5051-4d5b-a1ef-29e416c47323', '51e8e0f5-a893-419b-8d8e-4c584d4c7b6a', '0a98c516-b394-4374-845c-9ec6fda8d0ff'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:42 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:42 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Acquiring lock "cinder-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Lock "cinder-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Acquiring lock "cinder-quobyte-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:42 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23" returned: 0 in 0.929s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Lock "cinder-quobyte-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906" acquired by "delete_volume" :: waited 0.041s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:42 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23 Jul 11 18:44:42 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f87aff6-e641-47d5-b210-b05e4becdce7]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:42 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 Jul 11 18:44:42 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:43 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.828s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:43 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Deleted volume successfully. Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dabbc6ea-0cd8-4e48-8628-bc94cae98277 tempest-VolumeRetypeWithoutMigrationTest-1256234806 None] Lock "cinder-2aabeff0-3a78-464c-9541-6235a67674a5-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:43 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e077ae08-f043-43c6-a43f-2e2895dd0c23" returned: 0 in 0.825s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Lock "cinder-quobyte-e077ae08-f043-43c6-a43f-2e2895dd0c23" released by "delete_volume" :: held 1.808s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Created reservations ['cb96e886-891d-410c-9143-9c83daefd248', '18324159-d3fe-46e7-a18e-2fd985bc77cf', 'b214f0dc-1dda-4c43-9b3e-a6c9cc6c6fc6', '8b7db8f8-8934-42db-ade2-65200b026a22'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:43 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906" returned: 0 in 0.902s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:43 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906 Jul 11 18:44:43 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:43 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:43 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:44 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.064s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:44 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:44 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906" returned: 0 in 1.138s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Deleted volume successfully. Jul 11 18:44:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Lock "cinder-quobyte-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906" released by "delete_volume" :: held 2.116s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-43c2a264-bc1e-4953-b4c0-2c04687c5d3a tempest-SnapshotsActionsTest-534925015 None] Lock "cinder-e077ae08-f043-43c6-a43f-2e2895dd0c23-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:45 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Created reservations ['c8c98741-f160-46e1-a585-a428fe173c4c', '9073be55-d857-46cc-a17e-759af3c1b56a', '5fd7cb92-5e19-4ba8-b809-03ca41f09292', '1f8b595c-dd9e-41a8-93e8-887ff9449a29'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:45 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:45 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:45 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.797s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:45 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:45 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Deleted volume successfully. Jul 11 18:44:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2fefd6be-341f-44f3-8132-5fa69d7acca6 tempest-VolumesTransfersV357Test-561132077 None] Lock "cinder-2cfa23a6-52ac-4bb6-b7bf-cbad46f5f906-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Flow 'volume_create_manager' (c8eb69cb-6e32-46b2-8851-c989fc65d58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96749882-be37-438e-8fdc-b7f83a9f21b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96749882-be37-438e-8fdc-b7f83a9f21b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-604242136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2c63249c234e6f9f7c453451bb0672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:47Z,use_quota=True,user_id='b551b458a69b441d9af89be554a5933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fe2b5e-d87d-4264-8d83-33f197aded00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fe2b5e-d87d-4264-8d83-33f197aded00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a939c5d-a08e-4e5d-b125-e015836ce5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a939c5d-a08e-4e5d-b125-e015836ce5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e', 'volume_name': 'volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3946c8-a592-4687-9f25-cef83f8d5d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3946c8-a592-4687-9f25-cef83f8d5d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abf2a09-f81e-451e-a56f-b4d2f7343c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:46 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Volume f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e', 'volume_size': 1} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-604242136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2c63249c234e6f9f7c453451bb0672',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:47Z,use_quota=True,user_id='b551b458a69b441d9af89be554a5933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Creating volume f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:46 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:44:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:47 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e 1073741824 Jul 11 18:44:47 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-01772da7-4545-4b27-96cd-46759d756e45 req-1f6663f6-f2e7-4701-a9a9-6d2be24c8e3b tempest-ServerActionsTestOtherA-1450210066 None] Terminate volume connection completed successfully. Jul 11 18:44:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-01772da7-4545-4b27-96cd-46759d756e45 req-1f6663f6-f2e7-4701-a9a9-6d2be24c8e3b tempest-ServerActionsTestOtherA-1450210066 None] Deleting attachment f18561b6-6eb0-456f-8b10-a6b1f4780032. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:44:48 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e 1073741824" returned: 0 in 1.024s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:48 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e Jul 11 18:44:48 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:48 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e" returned: 0 in 0.954s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abf2a09-f81e-451e-a56f-b4d2f7343c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5709099c-4ac5-4c40-8550-03517965c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:49 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Volume volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e (f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e): created successfully Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5709099c-4ac5-4c40-8550-03517965c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Flow 'volume_create_manager' (c8eb69cb-6e32-46b2-8851-c989fc65d58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:49 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-84536ce3-c721-49d1-a6a2-6a09f4b0c00f tempest-VolumesTransfersV357Test-29632842 None] Created volume successfully. Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:INSERT=41,cinder:UPDATE=145,cinder:SELECT=121,cinder:DELETE=9 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-01772da7-4545-4b27-96cd-46759d756e45 req-fb867ec7-ced9-4239-9350-a4afe153dd33 tempest-ServerActionsTestOtherA-1450210066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-01772da7-4545-4b27-96cd-46759d756e45 req-fb867ec7-ced9-4239-9350-a4afe153dd33 tempest-ServerActionsTestOtherA-1450210066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a4b514-115d-4d7a-a864-1107f614661b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-01772da7-4545-4b27-96cd-46759d756e45 req-fb867ec7-ced9-4239-9350-a4afe153dd33 tempest-ServerActionsTestOtherA-1450210066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:50 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 Jul 11 18:44:50 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Acquiring lock "cinder-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Lock "cinder-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Acquiring lock "cinder-quobyte-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:44:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Lock "cinder-quobyte-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:44:50 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[86db07ca-24dc-424f-98e8-9321fa38dbb8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:44:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:50 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e Jul 11 18:44:50 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:50 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-01772da7-4545-4b27-96cd-46759d756e45 req-fb867ec7-ced9-4239-9350-a4afe153dd33 tempest-ServerActionsTestOtherA-1450210066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601" returned: 0 in 1.065s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-01772da7-4545-4b27-96cd-46759d756e45 req-fb867ec7-ced9-4239-9350-a4afe153dd33 tempest-ServerActionsTestOtherA-1450210066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.093s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-01772da7-4545-4b27-96cd-46759d756e45 req-fb867ec7-ced9-4239-9350-a4afe153dd33 tempest-ServerActionsTestOtherA-1450210066 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-54e6057c-db36-47d9-bdad-dcee3c287601', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9dfa900-4e5b-4069-8555-f368563beb37', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:44:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-01772da7-4545-4b27-96cd-46759d756e45 req-fb867ec7-ced9-4239-9350-a4afe153dd33 tempest-ServerActionsTestOtherA-1450210066 None] attachment_update completed successfully. Jul 11 18:44:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:44:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:51 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:51 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:51 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e" returned: 0 in 1.295s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:51 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e Jul 11 18:44:51 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:52 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.027s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:44:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 8 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:44:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:44:52 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e" returned: 0 in 0.884s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Lock "cinder-quobyte-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e" released by "delete_volume" :: held 2.259s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:52 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Created reservations ['35d1415c-4b86-47e7-957f-5835ecf22d09', 'ee86c88c-6269-43bb-9420-0f84739c226b', 'ae0970a9-5dc0-41fc-95d7-d88940d1b3d5', 'fafacfd8-b119-4277-a919-60a52aae4610'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:44:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:53 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:44:53 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:44:54 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 11 18:44:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.064s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:44:54 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:44:54 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Deleted volume successfully. Jul 11 18:44:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b1159e9-b74e-4b33-9969-25bdc959df65 tempest-VolumesTransfersV357Test-561132077 None] Lock "cinder-f3e1bb50-52d9-4fe8-a86b-1e202e5f4f2e-delete_volume" released by "delete_volume" :: held 3.631s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Flow 'volume_create_manager' (fc19d76a-ff36-4cf2-99fa-43a2ef513bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb40a369-290a-41cc-92a9-8653d5be2d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb40a369-290a-41cc-92a9-8653d5be2d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1888910919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0597e3f-f0a0-4e44-b062-6b9e9b6118bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77a0ae541aba4e8b8bde11981de9ef00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:59Z,use_quota=True,user_id='60635f1bced444beada5b0eb821a268f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89e07d8-a929-4915-821f-3afb0a1ee79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89e07d8-a929-4915-821f-3afb0a1ee79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb4cb55-1956-4e64-b79d-80c3c19b1748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb4cb55-1956-4e64-b79d-80c3c19b1748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0597e3f-f0a0-4e44-b062-6b9e9b6118bf', 'volume_name': 'volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecd5c51-18a0-45c9-9305-0da08c414cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecd5c51-18a0-45c9-9305-0da08c414cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159c1fc4-dace-4e34-a7db-5532e91e3f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:44:58 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Volume c0597e3f-f0a0-4e44-b062-6b9e9b6118bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf', 'volume_size': 1} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1888910919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0597e3f-f0a0-4e44-b062-6b9e9b6118bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77a0ae541aba4e8b8bde11981de9ef00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:44:59Z,use_quota=True,user_id='60635f1bced444beada5b0eb821a268f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Creating volume c0597e3f-f0a0-4e44-b062-6b9e9b6118bf {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:44:58 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:44:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:44:58 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf 1073741824 Jul 11 18:44:58 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:00 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf 1073741824" returned: 0 in 1.570s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:00 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf Jul 11 18:45:00 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:01 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" returned: 0 in 1.179s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.817s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:01 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159c1fc4-dace-4e34-a7db-5532e91e3f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:01 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31432761-dea4-45ce-8a10-4b6b6c4416b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:01 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Volume volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf (c0597e3f-f0a0-4e44-b062-6b9e9b6118bf): created successfully Jul 11 18:45:01 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31432761-dea4-45ce-8a10-4b6b6c4416b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:01 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Flow 'volume_create_manager' (fc19d76a-ff36-4cf2-99fa-43a2ef513bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:01 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-418e464f-afae-4ff7-b465-dfbe1a61836e tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Created volume successfully. Jul 11 18:45:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Creating offline snapshot 1f464b3c-c997-44d7-aa85-d15d911cfb94 of volume c0597e3f-f0a0-4e44-b062-6b9e9b6118bf {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:45:02 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[321adb4d-6496-4211-b727-f9b6d32ab4e1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:02 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf Jul 11 18:45:02 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:03 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" returned: 0 in 1.027s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:03 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 1G Jul 11 18:45:03 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:04 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 1G" returned: 0 in 1.082s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:04 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 Jul 11 18:45:04 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:05 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94" returned: 0 in 0.979s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:05 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 is being set with open permissions: ugo+rw Jul 11 18:45:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:05 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 Jul 11 18:45:05 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:06 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94" returned: 0 in 0.829s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:06 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.info Jul 11 18:45:06 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Flow 'volume_create_manager' (d974be21-35c6-426f-bd30-1ca1efd75683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5570d092-b5d2-4529-b465-7a085371ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5570d092-b5d2-4529-b465-7a085371ca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-522028939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314c09a9-c179-40b3-87a9-af9b52d1a02d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3713b0ee0804f4e9d7ed982433021cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:06Z,use_quota=True,user_id='28c7ada8f8764168b6c399ee3ed01a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63be769f-65d2-4c9f-a8a3-1f94bc2b8d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63be769f-65d2-4c9f-a8a3-1f94bc2b8d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a51f91-c4e0-41e4-9050-c6ac177ac10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a51f91-c4e0-41e4-9050-c6ac177ac10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '314c09a9-c179-40b3-87a9-af9b52d1a02d', 'volume_name': 'volume-314c09a9-c179-40b3-87a9-af9b52d1a02d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfb3e3e-31ca-43dc-b5e8-03c0d0c79426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfb3e3e-31ca-43dc-b5e8-03c0d0c79426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cc7c74-9f10-45f4-877e-1864999f38d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:06 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Volume 314c09a9-c179-40b3-87a9-af9b52d1a02d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-314c09a9-c179-40b3-87a9-af9b52d1a02d', 'volume_size': 1} Jul 11 18:45:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:07 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.info" returned: 0 in 0.732s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:07 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.info is being set with open permissions: ugo+rw Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:07 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.info Jul 11 18:45:07 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:07 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.info" returned: 0 in 0.719s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.515s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.244s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-522028939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314c09a9-c179-40b3-87a9-af9b52d1a02d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3713b0ee0804f4e9d7ed982433021cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:06Z,use_quota=True,user_id='28c7ada8f8764168b6c399ee3ed01a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Creating volume 314c09a9-c179-40b3-87a9-af9b52d1a02d {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:07 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:07 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=112,cinder:INSERT=24,cinder:UPDATE=112,cinder:DELETE=8 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:45:07 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d 1073741824 Jul 11 18:45:07 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-750a0c5e-fc0b-4b9f-b997-81809658a661 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Create snapshot completed successfully Jul 11 18:45:08 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d 1073741824" returned: 0 in 0.961s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:08 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d Jul 11 18:45:08 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Acquiring lock "cinder-1f464b3c-c997-44d7-aa85-d15d911cfb94-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "cinder-1f464b3c-c997-44d7-aa85-d15d911cfb94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Acquiring lock "cinder-quobyte-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "cinder-quobyte-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Acquiring lock "cinder-quobyte-1f464b3c-c997-44d7-aa85-d15d911cfb94" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "cinder-quobyte-1f464b3c-c997-44d7-aa85-d15d911cfb94" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Deleting offline snapshot 1f464b3c-c997-44d7-aa85-d15d911cfb94 of volume c0597e3f-f0a0-4e44-b062-6b9e9b6118bf {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] snapshot_file for this snap is: volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c41958-c3ae-4165-8fe8-29cce5cd8823]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:09 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 Jul 11 18:45:09 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:09 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d" returned: 0 in 0.910s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cc7c74-9f10-45f4-877e-1864999f38d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314c09a9-c179-40b3-87a9-af9b52d1a02d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3588145-9a66-4e72-8f4f-bd3c560d94cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:09 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Volume volume-314c09a9-c179-40b3-87a9-af9b52d1a02d (314c09a9-c179-40b3-87a9-af9b52d1a02d): created successfully Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3588145-9a66-4e72-8f4f-bd3c560d94cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Flow 'volume_create_manager' (d974be21-35c6-426f-bd30-1ca1efd75683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:09 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fa6999e9-1132-483b-93c3-79086bc94ad9 tempest-VolumesListTestJSON-2041608771 None] Created volume successfully. Jul 11 18:45:10 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94" returned: 0 in 0.911s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a349ebc-22fb-4188-a60f-b4aa30900e01]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:10 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf Jul 11 18:45:10 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Flow 'volume_create_manager' (1035a05f-230c-4076-8b0a-527538815ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebbf94e-342a-4e72-b354-42390517d57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebbf94e-342a-4e72-b354-42390517d57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-591597737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c10e39-046a-4bf7-89af-a7af00276dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81657b5548644a68bcf3e3a559b9d4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:10Z,use_quota=True,user_id='1316c1fdd7f84599a5886a991f3b7a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ec0166-dcf3-475a-b766-57fa70c540a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ec0166-dcf3-475a-b766-57fa70c540a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474d4f5b-8692-45b3-aa47-92d8d3f36844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474d4f5b-8692-45b3-aa47-92d8d3f36844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c10e39-046a-4bf7-89af-a7af00276dbd', 'volume_name': 'volume-c0c10e39-046a-4bf7-89af-a7af00276dbd', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059bd4ad-765e-48b3-9f02-012497697acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059bd4ad-765e-48b3-9f02-012497697acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a34d3a-acba-4086-97da-62fb9dbc553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:10 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Volume c0c10e39-046a-4bf7-89af-a7af00276dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c10e39-046a-4bf7-89af-a7af00276dbd', 'volume_size': 1} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-591597737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c10e39-046a-4bf7-89af-a7af00276dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81657b5548644a68bcf3e3a559b9d4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:10Z,use_quota=True,user_id='1316c1fdd7f84599a5886a991f3b7a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Creating volume c0c10e39-046a-4bf7-89af-a7af00276dbd {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:10 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:45:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:10 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd 1073741824 Jul 11 18:45:10 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:11 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" returned: 0 in 0.999s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:11 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 Jul 11 18:45:11 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Flow 'volume_create_manager' (58c04924-224d-4753-8822-a8e7a2f7df23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7aab7e7-e735-4391-af09-9a5fcc49a03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7aab7e7-e735-4391-af09-9a5fcc49a03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-26168522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6b31d7-31a2-4a12-aaf7-63346d39bddb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3713b0ee0804f4e9d7ed982433021cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:11Z,use_quota=True,user_id='28c7ada8f8764168b6c399ee3ed01a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f72a9b-ecf8-4d6d-ab11-4885d34d61a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f72a9b-ecf8-4d6d-ab11-4885d34d61a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc3a2f4-38c8-4924-8664-8e02ee33a84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc3a2f4-38c8-4924-8664-8e02ee33a84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e6b31d7-31a2-4a12-aaf7-63346d39bddb', 'volume_name': 'volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab6cdc0-f665-4fda-87b1-3dfe87273fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab6cdc0-f665-4fda-87b1-3dfe87273fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9b62d8-1f15-41f9-86fc-0a46b26051d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:11 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Volume 7e6b31d7-31a2-4a12-aaf7-63346d39bddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb', 'volume_size': 1} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:11 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd 1073741824" returned: 0 in 1.096s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:11 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd Jul 11 18:45:11 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:12 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94" returned: 0 in 0.805s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:12 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94 Jul 11 18:45:12 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:12 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd" returned: 0 in 0.646s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-26168522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6b31d7-31a2-4a12-aaf7-63346d39bddb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3713b0ee0804f4e9d7ed982433021cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:11Z,use_quota=True,user_id='28c7ada8f8764168b6c399ee3ed01a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Creating volume 7e6b31d7-31a2-4a12-aaf7-63346d39bddb {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:12 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a34d3a-acba-4086-97da-62fb9dbc553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c10e39-046a-4bf7-89af-a7af00276dbd', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12f71e-6e5e-4a98-bab7-46f5fbf1e794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:12 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb 1073741824 Jul 11 18:45:12 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:12 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Volume volume-c0c10e39-046a-4bf7-89af-a7af00276dbd (c0c10e39-046a-4bf7-89af-a7af00276dbd): created successfully Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12f71e-6e5e-4a98-bab7-46f5fbf1e794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Flow 'volume_create_manager' (1035a05f-230c-4076-8b0a-527538815ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:12 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e7c6ab24-6dd9-48fb-aa56-55bb7cf7e454 tempest-AbsoluteLimitsTests-438273082 None] Created volume successfully. Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Acquiring lock "cinder-c0c10e39-046a-4bf7-89af-a7af00276dbd-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Lock "cinder-c0c10e39-046a-4bf7-89af-a7af00276dbd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:12 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Acquiring lock "cinder-quobyte-c0c10e39-046a-4bf7-89af-a7af00276dbd" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf.1f464b3c-c997-44d7-aa85-d15d911cfb94" returned: 0 in 0.674s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Lock "cinder-quobyte-c0c10e39-046a-4bf7-89af-a7af00276dbd" acquired by "delete_volume" :: waited 0.038s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "cinder-quobyte-1f464b3c-c997-44d7-aa85-d15d911cfb94" released by "_delete_snapshot" :: held 3.530s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "cinder-quobyte-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" released by "delete_snapshot" :: held 3.568s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11bb91b-0922-4bd4-9dc9-0901306071ec]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:12 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Created reservations ['c78be965-2802-4ac6-9e04-3ff078dca4e0', '7085cdce-c6ea-44e3-b1be-12bf01d7a736', '467fff21-4f54-41ff-a2a6-5df9ddc94a24', '58eb8058-ad54-4f87-b0ed-068379c38ef1'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:13 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd Jul 11 18:45:13 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:13 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Delete snapshot completed successfully. Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c4e34067-34f5-443a-ac9c-ecc26ad6e14f tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "cinder-1f464b3c-c997-44d7-aa85-d15d911cfb94-delete_snapshot" released by "delete_snapshot" :: held 3.723s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:13 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb 1073741824" returned: 0 in 0.889s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:13 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb Jul 11 18:45:13 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:13 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd" returned: 0 in 0.764s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:13 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd Jul 11 18:45:13 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Acquiring lock "cinder-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "cinder-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Acquiring lock "cinder-quobyte-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "cinder-quobyte-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba080cd-89cf-4d17-aa36-929495b24841]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:13 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf Jul 11 18:45:13 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:14 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb" returned: 0 in 0.667s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9b62d8-1f15-41f9-86fc-0a46b26051d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916fcb6b-02a2-4e26-bd33-ef6c3737c33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:14 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Volume volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb (7e6b31d7-31a2-4a12-aaf7-63346d39bddb): created successfully Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916fcb6b-02a2-4e26-bd33-ef6c3737c33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Flow 'volume_create_manager' (58c04924-224d-4753-8822-a8e7a2f7df23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:14 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7519362d-5b6f-40f4-a7cb-229f71622bde tempest-VolumesListTestJSON-2041608771 None] Created volume successfully. Jul 11 18:45:14 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0c10e39-046a-4bf7-89af-a7af00276dbd" returned: 0 in 0.662s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Lock "cinder-quobyte-c0c10e39-046a-4bf7-89af-a7af00276dbd" released by "delete_volume" :: held 1.475s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Created reservations ['2e4e2e4c-8c5e-4da9-9d39-68c3339056b7', 'b48d0d5e-ef26-4ab6-86c8-bcf52fe7502d', '7926b65a-0f6b-459e-8c8f-f194a435dc9f', 'd8bf02df-5d78-4033-b4f0-c220c8809c1d'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:14 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:45:14 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:14 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" returned: 0 in 0.786s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:14 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf Jul 11 18:45:14 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Flow 'volume_create_manager' (fced9a81-2c19-441a-877c-17a197c80749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9562b9b-a2b6-438a-ac55-1c5dc518ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9562b9b-a2b6-438a-ac55-1c5dc518ef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-343816097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e49b6b4-b95e-46a2-acdc-3d7338f64183,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3713b0ee0804f4e9d7ed982433021cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:15Z,use_quota=True,user_id='28c7ada8f8764168b6c399ee3ed01a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bccae5-cb49-431d-bf4c-4274e7643990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bccae5-cb49-431d-bf4c-4274e7643990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15adca4d-622e-4aac-a13e-b37ed13bbb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15adca4d-622e-4aac-a13e-b37ed13bbb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e49b6b4-b95e-46a2-acdc-3d7338f64183', 'volume_name': 'volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56ea945-0632-469a-a78e-3a607817a3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56ea945-0632-469a-a78e-3a607817a3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4da7306-d3f2-4914-8bcd-b0ad26c25ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Volume 5e49b6b4-b95e-46a2-acdc-3d7338f64183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183', 'volume_size': 1} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-343816097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e49b6b4-b95e-46a2-acdc-3d7338f64183,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b3713b0ee0804f4e9d7ed982433021cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:15Z,use_quota=True,user_id='28c7ada8f8764168b6c399ee3ed01a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Creating volume 5e49b6b4-b95e-46a2-acdc-3d7338f64183 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:15 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:15 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.752s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Deleted volume successfully. Jul 11 18:45:15 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183 1073741824 Jul 11 18:45:15 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dbb21fff-4733-4838-ac91-a64493680aee tempest-AbsoluteLimitsTests-438273082 None] Lock "cinder-c0c10e39-046a-4bf7-89af-a7af00276dbd-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:15 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" returned: 0 in 0.769s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "cinder-quobyte-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf" released by "delete_volume" :: held 1.616s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Created reservations ['580e4c99-df3d-47c4-9cbc-6347c69bd5e7', 'c632e303-6a28-433d-b4fc-102d06c69e2d', 'c6572ea9-f631-4a56-bbd5-064a36d6dff5', '95bc0127-16f7-4cd0-89f6-dca594288bb4'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:15 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:45:15 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:16 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183 1073741824" returned: 0 in 1.014s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:16 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183 Jul 11 18:45:16 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:16 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.780s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:16 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:16 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Deleted volume successfully. Jul 11 18:45:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c3698516-9956-49bf-a4f0-129e81dd5420 tempest-VolumeSnapshotQuotasNegativeTestJSON-188554294 None] Lock "cinder-c0597e3f-f0a0-4e44-b062-6b9e9b6118bf-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:17 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183" returned: 0 in 0.794s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4da7306-d3f2-4914-8bcd-b0ad26c25ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b490144-516a-4f4b-8ee4-c9194cc1813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:17 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Volume volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183 (5e49b6b4-b95e-46a2-acdc-3d7338f64183): created successfully Jul 11 18:45:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b490144-516a-4f4b-8ee4-c9194cc1813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Flow 'volume_create_manager' (fced9a81-2c19-441a-877c-17a197c80749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a4321839-17ec-4e02-93d4-bc98739ce482 tempest-VolumesListTestJSON-2041608771 None] Created volume successfully. Jul 11 18:45:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "cinder-5e49b6b4-b95e-46a2-acdc-3d7338f64183-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-5e49b6b4-b95e-46a2-acdc-3d7338f64183-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "cinder-quobyte-5e49b6b4-b95e-46a2-acdc-3d7338f64183" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-quobyte-5e49b6b4-b95e-46a2-acdc-3d7338f64183" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:19 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d897e629-a872-4f3d-bfe4-c4b39b7ad81d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:20 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183 Jul 11 18:45:20 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:20 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Flow 'volume_create_manager' (c59ac469-027e-4d2c-85dc-e9f55af7b0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c898cf25-3162-4976-94bf-e067a0b9104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c898cf25-3162-4976-94bf-e067a0b9104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2043324180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c68bcd2-75b9-44b6-8aeb-ffea63b205cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ce036639a2432aa5b5a3da82e6ddf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:21Z,use_quota=True,user_id='268bad8accda4451acc93b65501e9b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43de9f14-855a-4b22-84b4-ce65b92a41df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43de9f14-855a-4b22-84b4-ce65b92a41df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e9b076-c272-4e81-b664-aa4cdda22d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e9b076-c272-4e81-b664-aa4cdda22d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c68bcd2-75b9-44b6-8aeb-ffea63b205cd', 'volume_name': 'volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:21 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26fe871-15e7-48d0-a3c1-5ec5a78785ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26fe871-15e7-48d0-a3c1-5ec5a78785ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e463aa-d9a1-4ebe-a82b-874300e0ebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:21 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Volume 1c68bcd2-75b9-44b6-8aeb-ffea63b205cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd', 'volume_size': 1} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2043324180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c68bcd2-75b9-44b6-8aeb-ffea63b205cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ce036639a2432aa5b5a3da82e6ddf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:21Z,use_quota=True,user_id='268bad8accda4451acc93b65501e9b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Creating volume 1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:21 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183" returned: 0 in 1.136s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:21 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd 1073741824 Jul 11 18:45:21 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:21 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183 Jul 11 18:45:21 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:21 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e49b6b4-b95e-46a2-acdc-3d7338f64183" returned: 0 in 0.890s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-quobyte-5e49b6b4-b95e-46a2-acdc-3d7338f64183" released by "delete_volume" :: held 2.095s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:22 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Created reservations ['30d05ca2-7144-4940-b632-f482257ad34c', '80ec2921-0eb3-44c4-b2b3-b20181879f1a', '7ad95332-15d3-440a-a167-75add0dece5a', '10a925a4-c246-49ad-bc8a-d6322ca51c7a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:22 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:45:22 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:22 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd 1073741824" returned: 0 in 1.262s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:22 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd Jul 11 18:45:22 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:23 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.825s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:23 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Deleted volume successfully. Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-846c3719-a3b2-4bd6-a266-eb19bef6c272 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-5e49b6b4-b95e-46a2-acdc-3d7338f64183-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:23 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" returned: 0 in 0.881s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "cinder-7e6b31d7-31a2-4a12-aaf7-63346d39bddb-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e463aa-d9a1-4ebe-a82b-874300e0ebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748a1004-efb5-4d82-a837-d4039c74d743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Volume volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd (1c68bcd2-75b9-44b6-8aeb-ffea63b205cd): created successfully Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748a1004-efb5-4d82-a837-d4039c74d743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Flow 'volume_create_manager' (c59ac469-027e-4d2c-85dc-e9f55af7b0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-7e6b31d7-31a2-4a12-aaf7-63346d39bddb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:23 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a2ef21da-6a39-4543-8676-bc60703abff8 tempest-VolumesDeleteCascade-1703041302 None] Created volume successfully. Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "cinder-quobyte-7e6b31d7-31a2-4a12-aaf7-63346d39bddb" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-quobyte-7e6b31d7-31a2-4a12-aaf7-63346d39bddb" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d4425-a50f-442f-bb39-bf39330dece5]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:23 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb Jul 11 18:45:23 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Flow 'volume_create_manager' (bed977de-a3a3-47f4-887d-e25f853521c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae307a4-2d81-4603-9e29-8acad9e70266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae307a4-2d81-4603-9e29-8acad9e70266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1011180882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c2a4e9-5954-45bb-9405-69e348d89ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3705dc575f584494a0bdbf4790f25038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:24Z,use_quota=True,user_id='8618810027cf4ca1ae068ee3d491af19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36e69926-0dc5-4d77-b363-d2b6cbf3ad02),volume_type_id=36e69926-0dc5-4d77-b363-d2b6cbf3ad02)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c6d581-e281-49c2-9d02-381ade560332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c6d581-e281-49c2-9d02-381ade560332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5480c25-c47a-49b1-aabe-2afa41b9edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5480c25-c47a-49b1-aabe-2afa41b9edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c2a4e9-5954-45bb-9405-69e348d89ba4', 'volume_name': 'volume-10c2a4e9-5954-45bb-9405-69e348d89ba4', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a516d2c1-c400-415b-bb96-0ce48adfd91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a516d2c1-c400-415b-bb96-0ce48adfd91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25812cfa-14ef-4419-8b4d-b5651fee1369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:23 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Volume 10c2a4e9-5954-45bb-9405-69e348d89ba4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c2a4e9-5954-45bb-9405-69e348d89ba4', 'volume_size': 1} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1011180882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c2a4e9-5954-45bb-9405-69e348d89ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3705dc575f584494a0bdbf4790f25038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:24Z,use_quota=True,user_id='8618810027cf4ca1ae068ee3d491af19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36e69926-0dc5-4d77-b363-d2b6cbf3ad02),volume_type_id=36e69926-0dc5-4d77-b363-d2b6cbf3ad02)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Creating volume 10c2a4e9-5954-45bb-9405-69e348d89ba4 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:23 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:45:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:23 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4 1073741824 Jul 11 18:45:23 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-40046c43-8237-4b8c-ad5e-ca6c6ebb54ca req-5e2d66c3-99df-4506-9187-84e0ef329de8 tempest-ServerActionsTestOtherA-1450210066 None] Terminate volume connection completed successfully. Jul 11 18:45:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-40046c43-8237-4b8c-ad5e-ca6c6ebb54ca req-5e2d66c3-99df-4506-9187-84e0ef329de8 tempest-ServerActionsTestOtherA-1450210066 None] Deleting attachment d9dfa900-4e5b-4069-8555-f368563beb37. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:45:24 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb" returned: 0 in 0.850s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:24 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb Jul 11 18:45:24 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:24 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4 1073741824" returned: 0 in 0.951s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:24 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4 Jul 11 18:45:24 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:24 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7e6b31d7-31a2-4a12-aaf7-63346d39bddb" returned: 0 in 0.708s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-quobyte-7e6b31d7-31a2-4a12-aaf7-63346d39bddb" released by "delete_volume" :: held 1.609s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Created reservations ['2e091d3a-d4b4-48be-9c28-0dc0fbf26926', '742ea6b8-35bc-4d0d-96c4-e92baae473ff', 'c7ff9b6e-f067-4faa-ade3-0da201b7fd31', '05b91283-21f8-42c8-83cf-093d9389ca46'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:25 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:45:25 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:25 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4" returned: 0 in 0.666s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.994s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25812cfa-14ef-4419-8b4d-b5651fee1369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c2a4e9-5954-45bb-9405-69e348d89ba4', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c52831-8010-469e-951d-062efff6c3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Creating offline snapshot a465e71c-80e6-46e4-b0ea-455da5f0db98 of volume 1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:45:25 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Volume volume-10c2a4e9-5954-45bb-9405-69e348d89ba4 (10c2a4e9-5954-45bb-9405-69e348d89ba4): created successfully Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c52831-8010-469e-951d-062efff6c3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Flow 'volume_create_manager' (bed977de-a3a3-47f4-887d-e25f853521c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f6722d-7050-47ce-ba19-e624783a4438]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:25 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7fc71484-e228-46b9-b9e3-2e0235145e8e tempest-VolumeTypesAccessTest-449943250 None] Created volume successfully. Jul 11 18:45:25 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd Jul 11 18:45:25 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "cinder-314c09a9-c179-40b3-87a9-af9b52d1a02d-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-314c09a9-c179-40b3-87a9-af9b52d1a02d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "cinder-quobyte-314c09a9-c179-40b3-87a9-af9b52d1a02d" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-quobyte-314c09a9-c179-40b3-87a9-af9b52d1a02d" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Acquiring lock "cinder-10c2a4e9-5954-45bb-9405-69e348d89ba4-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7742bf60-4b12-435f-9a03-722c6a4e40cd]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Lock "cinder-10c2a4e9-5954-45bb-9405-69e348d89ba4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:25 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.736s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:25 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Deleted volume successfully. Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Acquiring lock "cinder-quobyte-10c2a4e9-5954-45bb-9405-69e348d89ba4" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81a8df68-c7ce-4fdb-9023-b3861bc6f270 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-7e6b31d7-31a2-4a12-aaf7-63346d39bddb-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Lock "cinder-quobyte-10c2a4e9-5954-45bb-9405-69e348d89ba4" acquired by "delete_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:25 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d Jul 11 18:45:25 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2614b49-bd68-423f-a27e-6fd3bd8cf254]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:26 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4 Jul 11 18:45:26 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:26 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" returned: 0 in 1.056s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:26 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 1G Jul 11 18:45:26 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:26 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d" returned: 0 in 0.888s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:26 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d Jul 11 18:45:26 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:26 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4" returned: 0 in 0.895s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:26 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4 Jul 11 18:45:26 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:27 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 1G" returned: 0 in 0.800s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:27 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 Jul 11 18:45:27 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:27 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-314c09a9-c179-40b3-87a9-af9b52d1a02d" returned: 0 in 0.689s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-quobyte-314c09a9-c179-40b3-87a9-af9b52d1a02d" released by "delete_volume" :: held 1.642s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Created reservations ['b3b248a0-322b-4819-82f1-417a4fdf569a', '35acb180-88d1-4dee-9713-b31da58dfac3', 'd5b15df8-8ceb-4476-8247-94acd9d3cd63', '7794d67e-3bb7-465f-bae4-5aaf6e554e4e'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:27 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-10c2a4e9-5954-45bb-9405-69e348d89ba4" returned: 0 in 0.709s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:27 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:45:27 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Lock "cinder-quobyte-10c2a4e9-5954-45bb-9405-69e348d89ba4" released by "delete_volume" :: held 1.665s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:27 devstack cinder-volume[87411]: WARNING cinder.quota [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-526717338 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-526717338, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:45:27 devstack cinder-volume[87411]: WARNING cinder.quota [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-526717338 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-526717338, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Created reservations ['e17e2f0f-c0e6-48e1-853f-443f81155caa', '4a255124-95a4-47d2-a01c-22df45f17093', '056c0d99-2e35-4009-ba4f-f306ea9eebaf', '64ff151f-7047-4547-b2f3-5739584f3b17'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:27 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:45:27 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:27 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98" returned: 0 in 0.738s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:27 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 is being set with open permissions: ugo+rw Jul 11 18:45:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:28 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 Jul 11 18:45:28 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:28 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.990s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:28 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:28 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Deleted volume successfully. Jul 11 18:45:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92ad2a6d-835d-4ef0-aa67-edcef2d45185 tempest-VolumesListTestJSON-2041608771 None] Lock "cinder-314c09a9-c179-40b3-87a9-af9b52d1a02d-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:28 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.207s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:28 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:28 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Deleted volume successfully. Jul 11 18:45:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7cd473fb-1d2b-4eb1-965b-9cf81071d28b tempest-VolumeTypesAccessTest-449943250 None] Lock "cinder-10c2a4e9-5954-45bb-9405-69e348d89ba4-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:29 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98" returned: 0 in 1.156s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:29 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.info Jul 11 18:45:29 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:30 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.info" returned: 0 in 0.952s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:30 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.info is being set with open permissions: ugo+rw Jul 11 18:45:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:30 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.info Jul 11 18:45:30 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:30 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.info" returned: 0 in 0.755s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.626s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:30 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c5619eaa-da81-459f-9967-e0900966023d tempest-VolumesDeleteCascade-1703041302 None] Create snapshot completed successfully Jul 11 18:45:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] Creating offline snapshot b0040025-f7f7-4286-a251-fa90e4dbde1c of volume 1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:45:32 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e6060-0684-4eb8-80db-5fad0f62128f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:32 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 Jul 11 18:45:32 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:32 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98" returned: 0 in 0.942s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:45:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:33 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c 1G Jul 11 18:45:33 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:33 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c 1G" returned: 0 in 1.008s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:34 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c Jul 11 18:45:34 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:34 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c" returned: 0 in 0.802s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:34 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c is being set with open permissions: ugo+rw Jul 11 18:45:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:34 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c Jul 11 18:45:34 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Acquiring lock "cinder-54e6057c-db36-47d9-bdad-dcee3c287601-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Lock "cinder-54e6057c-db36-47d9-bdad-dcee3c287601-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Acquiring lock "cinder-quobyte-54e6057c-db36-47d9-bdad-dcee3c287601" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:35 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c" returned: 0 in 0.900s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Lock "cinder-quobyte-54e6057c-db36-47d9-bdad-dcee3c287601" acquired by "delete_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.794s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:35 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0ec4b7-6df9-4b62-b897-5eefdfc153c8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0760a106-0580-44fa-affb-5287e952603e tempest-VolumesDeleteCascade-1703041302 None] Create snapshot completed successfully Jul 11 18:45:35 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 Jul 11 18:45:35 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Performing cascade delete. {{(pid=87411) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-a465e71c-80e6-46e4-b0ea-455da5f0db98-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-a465e71c-80e6-46e4-b0ea-455da5f0db98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-a465e71c-80e6-46e4-b0ea-455da5f0db98" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-a465e71c-80e6-46e4-b0ea-455da5f0db98" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Deleting offline snapshot a465e71c-80e6-46e4-b0ea-455da5f0db98 of volume 1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] snapshot_file for this snap is: volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9689c0bb-afcf-4f14-906d-efd3cdc437d5]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:36 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 Jul 11 18:45:36 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:36 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601" returned: 0 in 1.024s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:36 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601 Jul 11 18:45:36 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:37 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98" returned: 0 in 1.097s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f15fd5d-f121-4dcc-83a8-8acc5b097194]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:37 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-54e6057c-db36-47d9-bdad-dcee3c287601" returned: 0 in 0.825s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Lock "cinder-quobyte-54e6057c-db36-47d9-bdad-dcee3c287601" released by "delete_volume" :: held 1.939s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:37 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd Jul 11 18:45:37 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Created reservations ['adacf43e-4187-4c7f-89e4-c69c0b865272', 'e05d1161-1f7e-4fb6-a653-8c7345cc230d', '94c3ebc2-2994-4fb1-9bc0-f99f8d3d1b09', '08b02d17-4231-4eff-acd6-d9e297cb2306'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:37 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:45:37 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:38 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" returned: 0 in 1.212s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6180903-0fd1-4185-8511-1c0cb6276e80]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:38 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.106s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:38 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Deleted volume successfully. Jul 11 18:45:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92f221a5-c9a7-4633-b659-a5b46f047232 tempest-ServerActionsTestOtherA-1450210066 None] Lock "cinder-54e6057c-db36-47d9-bdad-dcee3c287601-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:39 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c Jul 11 18:45:39 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:39 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c" returned: 0 in 0.967s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:45:39 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[207172aa-732c-4329-8fcb-3e7bfc4f4322]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:40 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 Jul 11 18:45:40 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:40 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98" returned: 0 in 0.994s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:45:40 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b6545b-2cc3-4f27-819e-75c251eb0ce9]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:41 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd Jul 11 18:45:41 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:41 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" returned: 0 in 0.877s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:41 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 Jul 11 18:45:41 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:42 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98" returned: 0 in 0.850s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:42 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98 Jul 11 18:45:42 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:43 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.a465e71c-80e6-46e4-b0ea-455da5f0db98" returned: 0 in 0.940s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c -F qcow2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:43 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c -F qcow2 Jul 11 18:45:43 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Flow 'volume_create_manager' (a63c367a-2bca-4a09-bea2-1953dad1c88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798bb0ae-fafb-41e9-9a13-d684cbb8ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798bb0ae-fafb-41e9-9a13-d684cbb8ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2115647710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8134bf68-7ac7-4d25-aa8d-0bfa996d4723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341298d06d8e4d5fb08f3ad1acb6f0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:44Z,use_quota=True,user_id='d87e382510a24e609daa43f4dc7b1e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0769d180-f682-4b67-a4cb-e28863e8126e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0769d180-f682-4b67-a4cb-e28863e8126e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080761e1-fb1c-4ca6-8782-cf805109c551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080761e1-fb1c-4ca6-8782-cf805109c551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8134bf68-7ac7-4d25-aa8d-0bfa996d4723', 'volume_name': 'volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cf41d3-ea38-443e-a5ae-d3b147792ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cf41d3-ea38-443e-a5ae-d3b147792ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35071fb9-9883-40a4-af32-651a1f0dac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:44 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Volume 8134bf68-7ac7-4d25-aa8d-0bfa996d4723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723', 'volume_size': 1} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2115647710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8134bf68-7ac7-4d25-aa8d-0bfa996d4723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341298d06d8e4d5fb08f3ad1acb6f0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:44Z,use_quota=True,user_id='d87e382510a24e609daa43f4dc7b1e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Creating volume 8134bf68-7ac7-4d25-aa8d-0bfa996d4723 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:44 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:44 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c -F qcow2" returned: 0 in 0.926s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:44 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 1073741824 Jul 11 18:45:44 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-a465e71c-80e6-46e4-b0ea-455da5f0db98" released by "_delete_snapshot" :: held 8.132s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" released by "delete_snapshot" :: held 8.166s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Created reservations ['7fbae1fd-5a7a-4cd6-bdb8-8418a784f1fd', '7e3953f3-5d16-4a13-8478-7dabae13448e', 'cda4cb15-4391-4124-bf5a-3990d1094c8f', 'ae2b50ba-9dda-4154-a2ad-a26338775abc'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Delete snapshot completed successfully. Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-a465e71c-80e6-46e4-b0ea-455da5f0db98-delete_snapshot" released by "delete_snapshot" :: held 8.325s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-b0040025-f7f7-4286-a251-fa90e4dbde1c-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-b0040025-f7f7-4286-a251-fa90e4dbde1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-b0040025-f7f7-4286-a251-fa90e4dbde1c" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-b0040025-f7f7-4286-a251-fa90e4dbde1c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Deleting offline snapshot b0040025-f7f7-4286-a251-fa90e4dbde1c of volume 1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] snapshot_file for this snap is: volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cf2b6d-329e-48ed-85f8-bb3dfdb14215]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:44 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c Jul 11 18:45:44 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:45 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 1073741824" returned: 0 in 1.029s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:45 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 Jul 11 18:45:45 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:45 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c" returned: 0 in 0.880s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:45:45 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bdb318-686d-46a2-aae0-cd4bdcb88deb]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:45 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd Jul 11 18:45:45 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:46 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" returned: 0 in 0.707s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35071fb9-9883-40a4-af32-651a1f0dac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41f6c28-d013-48aa-84a1-27bcad88af7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:46 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Volume volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 (8134bf68-7ac7-4d25-aa8d-0bfa996d4723): created successfully Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41f6c28-d013-48aa-84a1-27bcad88af7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Flow 'volume_create_manager' (a63c367a-2bca-4a09-bea2-1953dad1c88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:46 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a25a1754-cc44-4b2d-b61c-e2ddedab38e1 tempest-VolumesSnapshotTestJSON-792565178 None] Created volume successfully. Jul 11 18:45:46 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" returned: 0 in 0.949s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:46 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c Jul 11 18:45:46 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Creating offline snapshot 5b7fed56-02ae-426f-b605-afa1a764d54b of volume 8134bf68-7ac7-4d25-aa8d-0bfa996d4723 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8867d06f-f8cb-4654-951c-cd8a7baa1229]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:46 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 Jul 11 18:45:46 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:47 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c" returned: 0 in 0.956s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:47 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c Jul 11 18:45:47 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:47 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" returned: 0 in 0.869s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:47 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b 1G Jul 11 18:45:47 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:48 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd.b0040025-f7f7-4286-a251-fa90e4dbde1c" returned: 0 in 0.813s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-b0040025-f7f7-4286-a251-fa90e4dbde1c" released by "_delete_snapshot" :: held 3.731s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" released by "delete_snapshot" :: held 3.770s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Created reservations ['cf6c7785-ff96-47ad-97d1-f616cee5bded', '7038985e-2342-41b5-8a6e-48c1b7b714a6', '2e3a01eb-5ac1-42c3-9d8e-b3652c0dc072', '4474dec3-6582-4a9e-8ddf-c621deda6f52'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:48 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Delete snapshot completed successfully. Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-b0040025-f7f7-4286-a251-fa90e4dbde1c-delete_snapshot" released by "delete_snapshot" :: held 4.035s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Snapshots deleted, issuing volume delete {{(pid=87411) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c101c297-0ce2-4bfb-9727-b3352dae2f69]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:48 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b 1G" returned: 0 in 1.119s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:48 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b Jul 11 18:45:48 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:48 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd Jul 11 18:45:48 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:49 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b" returned: 0 in 0.857s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:49 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b is being set with open permissions: ugo+rw Jul 11 18:45:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:49 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" returned: 0 in 0.949s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:49 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b Jul 11 18:45:49 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:49 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd Jul 11 18:45:49 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:50 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" returned: 0 in 0.759s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:50 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b" returned: 0 in 0.811s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=108,cinder:SELECT=90,cinder:INSERT=32,cinder:DELETE=13 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd" released by "delete_volume" :: held 1.800s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Created reservations ['85b80c74-dc56-405f-9d7d-75183f04704c', '1b8cfdd9-6bfa-4273-a8b8-f7ee28dd6488', '0ddee63c-1b2b-4556-86e4-e58d07683553', '7d2947a9-5e20-4615-a5d3-2230cfeab55f'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:50 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.info Jul 11 18:45:50 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:50 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:45:50 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:51 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:45:51 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:51 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.info" returned: 0 in 0.926s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:51 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.info is being set with open permissions: ugo+rw Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:51 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.info Jul 11 18:45:51 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:51 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.854s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Deleted volume successfully. Jul 11 18:45:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-da84dfed-a30f-4c9c-9375-e08e0a387085 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-1c68bcd2-75b9-44b6-8aeb-ffea63b205cd-delete_volume" released by "delete_volume" :: held 15.376s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:52 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.info" returned: 0 in 1.114s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.876s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:52 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2dfa10f8-f423-4d32-836d-10ea72a1e2e8 tempest-VolumesSnapshotTestJSON-792565178 None] Create snapshot completed successfully Jul 11 18:45:52 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.390s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 8 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Flow 'volume_create_manager' (5a19d9c8-2301-4063-897a-4a1b3ea87ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d748af2-cdc4-4aec-928b-33a289045c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d748af2-cdc4-4aec-928b-33a289045c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1273612660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151c7f35-813c-4ecf-a52d-df73e9b1fa2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ce036639a2432aa5b5a3da82e6ddf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:53Z,use_quota=True,user_id='268bad8accda4451acc93b65501e9b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f567524-e5f3-4026-b2f7-3a71ee4cc184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f567524-e5f3-4026-b2f7-3a71ee4cc184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18441238-8710-4c59-adb3-537c78782b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18441238-8710-4c59-adb3-537c78782b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151c7f35-813c-4ecf-a52d-df73e9b1fa2f', 'volume_name': 'volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc9e162-7b0e-4481-9a6d-69956151a824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc9e162-7b0e-4481-9a6d-69956151a824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c97c883-feca-424c-a783-b13364c6bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:52 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Volume 151c7f35-813c-4ecf-a52d-df73e9b1fa2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f', 'volume_size': 1} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1273612660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151c7f35-813c-4ecf-a52d-df73e9b1fa2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ce036639a2432aa5b5a3da82e6ddf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:53Z,use_quota=True,user_id='268bad8accda4451acc93b65501e9b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Creating volume 151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:45:52 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:45:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:53 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f 1073741824 Jul 11 18:45:53 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:53 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Flow 'volume_create_manager' (28cb17cc-ea3c-4802-94bf-10a03813e8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab7a74c-5e81-4a8d-b72a-067e758fe3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab7a74c-5e81-4a8d-b72a-067e758fe3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-156126663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba43c03-e5fb-4d25-aa47-4e4b3b6000d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993f3462c988484eb7e2cf014e1e7c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:53Z,use_quota=True,user_id='74acca3d22ae43d49d04881c5bc2bab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b0e514-d8c5-43fb-b5d6-79e186c6fbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b0e514-d8c5-43fb-b5d6-79e186c6fbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715e4fe8-d692-4aea-b350-cda86e27bab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:53 devstack cinder-volume[87411]: DEBUG cinder.image.glance [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Creating Keystone auth plugin from conf {{(pid=87411) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:45:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-5b7fed56-02ae-426f-b605-afa1a764d54b-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-5b7fed56-02ae-426f-b605-afa1a764d54b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:54 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f 1073741824" returned: 0 in 1.122s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-5b7fed56-02ae-426f-b605-afa1a764d54b" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715e4fe8-d692-4aea-b350-cda86e27bab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fba43c03-e5fb-4d25-aa47-4e4b3b6000d4', 'volume_name': 'volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950b5b77-b476-4f59-abe9-f96eab9ab570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950b5b77-b476-4f59-abe9-f96eab9ab570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ee7d04-5fa1-421d-a97b-2886c74333d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:54 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Volume fba43c03-e5fb-4d25-aa47-4e4b3b6000d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Trying to clone fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 from image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]). {{(pid=87411) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-5b7fed56-02ae-426f-b605-afa1a764d54b" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Deleting offline snapshot 5b7fed56-02ae-426f-b605-afa1a764d54b of volume 8134bf68-7ac7-4d25-aa8d-0bfa996d4723 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] snapshot_file for this snap is: volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdb3a19-ca3a-4484-8b81-02cbcfb7dcb3]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:54 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f Jul 11 18:45:54 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:54 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b Jul 11 18:45:54 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:45:54 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Image download 20.69 MB at 20.69 MB/s Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf48e29-8518-4fb7-87ab-02ff28cb4922]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:54 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD Jul 11 18:45:54 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:55 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" returned: 0 in 0.986s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:45:55 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c97c883-feca-424c-a783-b13364c6bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddf8728-34ae-49c8-b6c3-802b9b610c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b" returned: 0 in 1.047s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:45:55 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Volume volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f (151c7f35-813c-4ecf-a52d-df73e9b1fa2f): created successfully Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddf8728-34ae-49c8-b6c3-802b9b610c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Flow 'volume_create_manager' (5a19d9c8-2301-4063-897a-4a1b3ea87ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e6a073-dc9b-4c52-bad5-303418e68258]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fc6c8e0c-0369-4f63-bb61-4fb33e7b5908 tempest-VolumesDeleteCascade-1703041302 None] Created volume successfully. Jul 11 18:45:55 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 Jul 11 18:45:55 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:55 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD" returned: 0 in 0.963s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Temporary image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 is fetched for user 74acca3d22ae43d49d04881c5bc2bab0. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9739db23-d95f-4845-a378-c05e2d2e4ac6]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:55 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD Jul 11 18:45:55 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:45:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Creating offline snapshot ad4d4eb4-a806-4469-a84a-8c5893261fea of volume 151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:45:56 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" returned: 0 in 0.967s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:56 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[860d915d-2764-419e-b68c-83759cff5e16]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:45:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:56 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b Jul 11 18:45:56 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:56 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f Jul 11 18:45:56 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:56 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD" returned: 0 in 0.880s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:57 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b" returned: 0 in 0.835s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:57 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b Jul 11 18:45:57 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:57 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" returned: 0 in 0.862s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:57 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea 1G Jul 11 18:45:57 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:57 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723.5b7fed56-02ae-426f-b605-afa1a764d54b" returned: 0 in 0.791s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:57 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-5b7fed56-02ae-426f-b605-afa1a764d54b" released by "_delete_snapshot" :: held 3.798s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:57 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" released by "delete_snapshot" :: held 3.864s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Created reservations ['a19a3f22-cb42-43e8-8427-78c9d0873a5c', '86ed6685-0343-44b9-9b08-530957981f1f', '05d701db-ee3f-48cd-9902-ba0fc9b860df', '0b879fbb-436a-402d-903d-ebbbd65cce32'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:45:58 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea 1G" returned: 0 in 0.903s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:58 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea Jul 11 18:45:58 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:58 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Delete snapshot completed successfully. Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e610bcae-be1e-4795-a526-8b5ad7892cfe tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-5b7fed56-02ae-426f-b605-afa1a764d54b-delete_snapshot" released by "delete_snapshot" :: held 4.100s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:45:58 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Flow 'volume_create_manager' (c201c8c3-e40e-4d98-9aef-426d850e5ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b215e8-d5f8-4b32-be18-f65d80da3418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea" returned: 0 in 0.837s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:58 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea is being set with open permissions: ugo+rw Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:58 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b215e8-d5f8-4b32-be18-f65d80da3418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1557123676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae8ecee-2f9b-4002-a639-39d836fd49af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341298d06d8e4d5fb08f3ad1acb6f0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:59Z,use_quota=True,user_id='d87e382510a24e609daa43f4dc7b1e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:58 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fc8d95-9908-4264-b16e-1789682d5921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fc8d95-9908-4264-b16e-1789682d5921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944250ec-5a17-441f-be80-bf887352f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944250ec-5a17-441f-be80-bf887352f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae8ecee-2f9b-4002-a639-39d836fd49af', 'volume_name': 'volume-5ae8ecee-2f9b-4002-a639-39d836fd49af', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9882f4a0-60b6-4f17-8d8b-ef340795a230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9882f4a0-60b6-4f17-8d8b-ef340795a230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7ff726-9b59-4b2c-b964-a3435f68db85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:45:58 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Volume 5ae8ecee-2f9b-4002-a639-39d836fd49af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae8ecee-2f9b-4002-a639-39d836fd49af', 'volume_size': 1} Jul 11 18:45:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:45:59 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 11 18:45:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea" returned: 0 in 0.638s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:45:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:45:59 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.info Jul 11 18:45:59 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:00 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.info" returned: 0 in 0.698s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:00 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.info is being set with open permissions: ugo+rw Jul 11 18:46:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:00 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.info Jul 11 18:46:00 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:00 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.info" returned: 0 in 0.729s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.776s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.451s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-156126663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba43c03-e5fb-4d25-aa47-4e4b3b6000d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993f3462c988484eb7e2cf014e1e7c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:53Z,use_quota=True,user_id='74acca3d22ae43d49d04881c5bc2bab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Creating volume fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:01 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:46:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:01 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 1073741824 Jul 11 18:46:01 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9f9eb817-e4ff-4b68-ba74-77ecaad7de9a tempest-VolumesDeleteCascade-1703041302 None] Create snapshot completed successfully Jul 11 18:46:01 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:02 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 1073741824" returned: 0 in 1.053s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Flow 'volume_create_manager' (5f1d1c02-dc09-49d4-9073-750b62fbc012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3050739-4d56-469c-93fd-a912788e5f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3050739-4d56-469c-93fd-a912788e5f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-113846035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c007c53d-2cc4-44cc-b404-cd1d400dc29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ce036639a2432aa5b5a3da82e6ddf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad4d4eb4-a806-4469-a84a-8c5893261fea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:02Z,use_quota=True,user_id='268bad8accda4451acc93b65501e9b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537efb87-3f03-4fbe-a4a1-1bc76e600fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537efb87-3f03-4fbe-a4a1-1bc76e600fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec26105-d2bb-425c-9194-5658f4d5accd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec26105-d2bb-425c-9194-5658f4d5accd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c007c53d-2cc4-44cc-b404-cd1d400dc29c', 'volume_name': 'volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c', 'volume_size': 1, 'snapshot_id': 'ad4d4eb4-a806-4469-a84a-8c5893261fea'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3dc541-c0ca-474b-b14f-eb616c056698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3dc541-c0ca-474b-b14f-eb616c056698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910ae87b-c90a-4644-83be-2cec7a280fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:02 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Volume c007c53d-2cc4-44cc-b404-cd1d400dc29c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c', 'volume_size': 1, 'snapshot_id': 'ad4d4eb4-a806-4469-a84a-8c5893261fea'} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:02 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 Jul 11 18:46:02 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:02 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4" returned: 0 in 0.659s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.964s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1557123676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae8ecee-2f9b-4002-a639-39d836fd49af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341298d06d8e4d5fb08f3ad1acb6f0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:45:59Z,use_quota=True,user_id='d87e382510a24e609daa43f4dc7b1e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Creating volume 5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:02 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:02 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af 1073741824 Jul 11 18:46:02 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:02 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Attempting download of 7016bfdd-2d92-4c05-bebe-d2bb20b14820 ((None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}])) to volume fba43c03-e5fb-4d25-aa47-4e4b3b6000d4. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:46:03 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec348100-4d7a-4856-8787-a58c37e3bb47]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_1y6eb2v5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:03 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_1y6eb2v5 Jul 11 18:46:03 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:03 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af 1073741824" returned: 0 in 1.001s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:03 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_1y6eb2v5" returned: 0 in 0.887s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_1y6eb2v5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:04 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af Jul 11 18:46:04 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:04 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_1y6eb2v5 Jul 11 18:46:04 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:04 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af" returned: 0 in 0.782s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.488s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-ad4d4eb4-a806-4469-a84a-8c5893261fea-c007c53d-2cc4-44cc-b404-cd1d400dc29c" by "_create_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7ff726-9b59-4b2c-b964-a3435f68db85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae8ecee-2f9b-4002-a639-39d836fd49af', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344a5dde-5c15-4974-aa1e-7bb39887d1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-ad4d4eb4-a806-4469-a84a-8c5893261fea-c007c53d-2cc4-44cc-b404-cd1d400dc29c" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Creating volume c007c53d-2cc4-44cc-b404-cd1d400dc29c from snapshot ad4d4eb4-a806-4469-a84a-8c5893261fea {{(pid=87411) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-c007c53d-2cc4-44cc-b404-cd1d400dc29c" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:04 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Volume volume-5ae8ecee-2f9b-4002-a639-39d836fd49af (5ae8ecee-2f9b-4002-a639-39d836fd49af): created successfully Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344a5dde-5c15-4974-aa1e-7bb39887d1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Flow 'volume_create_manager' (c201c8c3-e40e-4d98-9aef-426d850e5ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-c007c53d-2cc4-44cc-b404-cd1d400dc29c" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] snapshot: ad4d4eb4-a806-4469-a84a-8c5893261fea, volume: c007c53d-2cc4-44cc-b404-cd1d400dc29c, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:04 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4e3d90f8-a47f-4cef-972b-57b0731a7553 tempest-VolumesSnapshotTestJSON-792565178 None] Created volume successfully. Jul 11 18:46:04 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_1y6eb2v5" returned: 1 in 0.932s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_1y6eb2v5' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[093734ef-a885-4604-ba44-9a4000cead3c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[15992230-a86d-45f0-95aa-9a5d9dcc58b6]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:05 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD Jul 11 18:46:05 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:05 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea Jul 11 18:46:05 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:06 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD" returned: 0 in 1.076s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:06 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] 7016bfdd-2d92-4c05-bebe-d2bb20b14820 was qcow2, converting to raw {{(pid=87411) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:46:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:06 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 Jul 11 18:46:06 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:06 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea" returned: 0 in 1.154s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:46:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:46:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:46:06 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a81f4f-1f3a-47e2-9f2a-a0b47073df35]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:06 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f Jul 11 18:46:06 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:06 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" returned: 0 in 0.880s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:07 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:46:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:07 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c Jul 11 18:46:07 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:08 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4" returned: 0 in 2.355s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:08 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_120p6mf7devstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:46:08 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Converted 112.00 MB image at 47.42 MB/s Jul 11 18:46:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:08 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 1G Jul 11 18:46:08 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:09 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 1G" returned: 0 in 1.575s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:10 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1acc69-eceb-4873-a2cc-021bdb81e506]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:10 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 Jul 11 18:46:10 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:11 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4" returned: 0 in 1.399s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:11 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 Jul 11 18:46:11 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:12 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c" returned: 0 in 5.885s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd5fb42-9b6c-48cd-8f08-23217987232d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:12 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4" returned: 1 in 1.531s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:46:12 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Downloaded image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 ((None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}])) to volume fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 successfully. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:46:12 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Temporary image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 for user 74acca3d22ae43d49d04881c5bc2bab0 is deleted. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:46:12 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Marking volume fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 as bootable. {{(pid=87411) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:46:12 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=104,cinder:UPDATE=128,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Copying metadata from image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 to fba43c03-e5fb-4d25-aa47-4e4b3b6000d4. {{(pid=87411) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Creating volume glance metadata for volume fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 backed by image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87411) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:46:13 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f Jul 11 18:46:13 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ee7d04-5fa1-421d-a97b-2886c74333d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab61092-db72-47ab-b967-a32a346bca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:13 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Volume volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 (fba43c03-e5fb-4d25-aa47-4e4b3b6000d4): created successfully Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab61092-db72-47ab-b967-a32a346bca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Flow 'volume_create_manager' (28cb17cc-ea3c-4802-94bf-10a03813e8fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:13 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-894ba737-4057-4ce7-816d-a4c9d7b3bca4 tempest-VolumesImageMetadata-186126699 None] Created volume successfully. Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Acquiring lock "cinder-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Lock "cinder-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Acquiring lock "cinder-quobyte-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:13 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" returned: 0 in 0.949s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:46:13 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Converted 1024.00 MB image at 173.94 MB/s Jul 11 18:46:13 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c is being set with open permissions: ugo+rw Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Lock "cinder-quobyte-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:13 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c Jul 11 18:46:13 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241bc18-8e91-4089-b488-99e87623df7b]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:14 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 Jul 11 18:46:14 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:14 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c" returned: 0 in 0.665s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-c007c53d-2cc4-44cc-b404-cd1d400dc29c" released by "_copy_volume_from_snapshot" :: held 9.673s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-ad4d4eb4-a806-4469-a84a-8c5893261fea-c007c53d-2cc4-44cc-b404-cd1d400dc29c" released by "_create_volume_from_snapshot" :: held 9.733s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.780s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.843s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Creating offline snapshot 14809458-80b5-4b2b-b827-a54a236fd54d of volume 5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9b843b-dba9-41fc-b066-2c2a6cc9c5d1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910ae87b-c90a-4644-83be-2cec7a280fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c', 'volume_size': 1, 'snapshot_id': 'ad4d4eb4-a806-4469-a84a-8c5893261fea'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54efa9eb-30e3-42d7-8852-8ba4f4e2b7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:14 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Volume volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c (c007c53d-2cc4-44cc-b404-cd1d400dc29c): created successfully Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54efa9eb-30e3-42d7-8852-8ba4f4e2b7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Flow 'volume_create_manager' (5f1d1c02-dc09-49d4-9073-750b62fbc012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:14 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b40eae23-6915-46ec-9468-64f7bb5d84e6 tempest-VolumesDeleteCascade-1703041302 None] Created volume successfully. Jul 11 18:46:14 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af Jul 11 18:46:14 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:14 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4" returned: 0 in 0.813s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:14 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 Jul 11 18:46:14 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:15 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af" returned: 0 in 0.806s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:15 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d 1G Jul 11 18:46:15 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:15 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4" returned: 1 in 0.777s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:15 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4 Jul 11 18:46:15 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-151c7f35-813c-4ecf-a52d-df73e9b1fa2f-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-151c7f35-813c-4ecf-a52d-df73e9b1fa2f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Performing cascade delete. {{(pid=87411) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-ad4d4eb4-a806-4469-a84a-8c5893261fea-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-ad4d4eb4-a806-4469-a84a-8c5893261fea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-ad4d4eb4-a806-4469-a84a-8c5893261fea" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-ad4d4eb4-a806-4469-a84a-8c5893261fea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Deleting offline snapshot ad4d4eb4-a806-4469-a84a-8c5893261fea of volume 151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] snapshot_file for this snap is: volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7435859a-6fe6-4dd2-a954-c75e191b4cab]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:15 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea Jul 11 18:46:15 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:16 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4" returned: 0 in 0.760s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:16 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Lock "cinder-quobyte-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4" released by "delete_volume" :: held 2.434s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d 1G" returned: 0 in 0.919s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae8ecee-2f9b-4002-a639-39d836fd49af -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:16 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae8ecee-2f9b-4002-a639-39d836fd49af -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d Jul 11 18:46:16 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Created reservations ['7d7ba4cd-438e-4628-920c-e1a7ca07a7be', 'fbeebaa7-760b-4f41-9adb-a3b9e5e6c152', 'd82c9944-3283-4162-a965-0c7cbe333fe9', '47205ed9-cd88-4f4d-9357-1bdaf70d86ad'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:16 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:46:16 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:16 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea" returned: 0 in 0.830s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[085797f8-8f12-4395-9859-f2e39a6b4cc0]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:16 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f Jul 11 18:46:16 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:17 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae8ecee-2f9b-4002-a639-39d836fd49af -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d" returned: 0 in 0.744s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:17 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d is being set with open permissions: ugo+rw Jul 11 18:46:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:17 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d Jul 11 18:46:17 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:17 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.762s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:17 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Deleted volume successfully. Jul 11 18:46:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5ef687d-ee49-4f5f-a3cf-9cbde585a640 tempest-VolumesImageMetadata-186126699 None] Lock "cinder-fba43c03-e5fb-4d25-aa47-4e4b3b6000d4-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:17 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" returned: 0 in 1.288s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:17 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea Jul 11 18:46:17 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:18 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d" returned: 0 in 1.053s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:18 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.info Jul 11 18:46:18 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:18 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea" returned: 0 in 1.023s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:19 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea Jul 11 18:46:19 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:19 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.info" returned: 0 in 0.951s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:19 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.info is being set with open permissions: ugo+rw Jul 11 18:46:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:19 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.info Jul 11 18:46:19 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:19 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f.ad4d4eb4-a806-4469-a84a-8c5893261fea" returned: 0 in 0.870s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-ad4d4eb4-a806-4469-a84a-8c5893261fea" released by "_delete_snapshot" :: held 4.119s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" released by "delete_snapshot" :: held 4.145s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:19 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Created reservations ['66d3f467-3968-4f4e-ac2c-3bb30f28a52a', '7e0ac6db-6f53-4855-8beb-b42b3fa282a6', 'de74062c-309a-41c0-a5c7-dedcc91e2ddd', 'cc7c5672-3125-4f5b-9389-a33202ebbeb5'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Delete snapshot completed successfully. Jul 11 18:46:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-ad4d4eb4-a806-4469-a84a-8c5893261fea-delete_snapshot" released by "delete_snapshot" :: held 4.323s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Snapshots deleted, issuing volume delete {{(pid=87411) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 11 18:46:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:20 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.info" returned: 0 in 0.947s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.530s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:20 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a99a3f-651e-471a-b185-eadd0be304fa]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-360f7493-4ba5-486f-94f1-028d2108abb9 tempest-VolumesSnapshotTestJSON-792565178 None] Create snapshot completed successfully Jul 11 18:46:20 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f Jul 11 18:46:20 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:20 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" returned: 0 in 0.890s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:21 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f Jul 11 18:46:21 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Flow 'volume_create_manager' (3f4c58cf-ed20-450d-882d-73517ce0c0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c773186-1ab5-4670-9bd0-e163089adfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c773186-1ab5-4670-9bd0-e163089adfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1892554804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59679d37-44df-4bff-9486-ea71d41f33f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341298d06d8e4d5fb08f3ad1acb6f0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=14809458-80b5-4b2b-b827-a54a236fd54d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:21Z,use_quota=True,user_id='d87e382510a24e609daa43f4dc7b1e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bcca6f-4acb-4a1e-bf5c-498bbd20e88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bcca6f-4acb-4a1e-bf5c-498bbd20e88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c398da-2668-424b-8397-630663e7d7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c398da-2668-424b-8397-630663e7d7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59679d37-44df-4bff-9486-ea71d41f33f0', 'volume_name': 'volume-59679d37-44df-4bff-9486-ea71d41f33f0', 'volume_size': 2, 'snapshot_id': '14809458-80b5-4b2b-b827-a54a236fd54d'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b41720-9c8f-45e7-a5e4-a215d41df18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b41720-9c8f-45e7-a5e4-a215d41df18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce42b995-bfd9-4861-a4d9-40774354381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:21 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Volume 59679d37-44df-4bff-9486-ea71d41f33f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59679d37-44df-4bff-9486-ea71d41f33f0', 'volume_size': 2, 'snapshot_id': '14809458-80b5-4b2b-b827-a54a236fd54d'} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-14809458-80b5-4b2b-b827-a54a236fd54d-59679d37-44df-4bff-9486-ea71d41f33f0" by "_create_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-14809458-80b5-4b2b-b827-a54a236fd54d-59679d37-44df-4bff-9486-ea71d41f33f0" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Creating volume 59679d37-44df-4bff-9486-ea71d41f33f0 from snapshot 14809458-80b5-4b2b-b827-a54a236fd54d {{(pid=87411) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-59679d37-44df-4bff-9486-ea71d41f33f0" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-59679d37-44df-4bff-9486-ea71d41f33f0" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] snapshot: 14809458-80b5-4b2b-b827-a54a236fd54d, volume: 59679d37-44df-4bff-9486-ea71d41f33f0, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d839562-c236-432d-9e2a-dd458eb704e6]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:21 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d Jul 11 18:46:21 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:21 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" returned: 0 in 0.756s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-151c7f35-813c-4ecf-a52d-df73e9b1fa2f" released by "delete_volume" :: held 1.739s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Created reservations ['62165170-f0cf-46d4-94a9-cc5af23c786c', '885cef89-3da8-4ee1-832d-430ddfc0ace1', 'd48abb9e-acb7-4062-a1e0-d6ca1fb2b6ba', '4fb07988-7fdc-4404-9656-27f941a628f5'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:21 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Flow 'volume_create_manager' (38b8ffd6-2201-493f-9d5c-9b1832b1608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8482c58-b8de-4704-97d1-6c3623653618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8482c58-b8de-4704-97d1-6c3623653618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-346721049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aec00d-41d6-474b-9303-969cafde6475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66032e2476f248e0b3e68e04ed06fece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:22Z,use_quota=True,user_id='737ac77957ca41a3b648347f57a75ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08347e6d-797e-4e48-8131-21eb0ce61799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08347e6d-797e-4e48-8131-21eb0ce61799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da67773-7c72-47c2-8166-5916170631df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.image.glance [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Creating Keystone auth plugin from conf {{(pid=87411) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:22 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:46:22 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da67773-7c72-47c2-8166-5916170631df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '91aec00d-41d6-474b-9303-969cafde6475', 'volume_name': 'volume-91aec00d-41d6-474b-9303-969cafde6475', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1083551b-82ec-4ede-85ce-1ca4df834644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1083551b-82ec-4ede-85ce-1ca4df834644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceeab3a0-c2d0-4c3f-a6d8-48e14e5cbe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:22 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Volume 91aec00d-41d6-474b-9303-969cafde6475: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-91aec00d-41d6-474b-9303-969cafde6475', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Trying to clone 91aec00d-41d6-474b-9303-969cafde6475 from image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]). {{(pid=87411) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-c007c53d-2cc4-44cc-b404-cd1d400dc29c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-c007c53d-2cc4-44cc-b404-cd1d400dc29c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:22 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d" returned: 0 in 1.066s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae8ecee-2f9b-4002-a639-39d836fd49af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5f9c61-5d5b-4774-94ef-edebe85ccae9]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "cinder-quobyte-c007c53d-2cc4-44cc-b404-cd1d400dc29c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-c007c53d-2cc4-44cc-b404-cd1d400dc29c" acquired by "delete_volume" :: waited 0.045s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[796a8e76-0523-4e3a-80cf-078d5b052f58]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:22 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af Jul 11 18:46:22 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:46:22 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Image download 20.69 MB at 20.69 MB/s Jul 11 18:46:22 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c Jul 11 18:46:22 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[742870da-bca8-47d8-9624-017a63051185]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:22 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.883s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:22 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:22 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Deleted volume successfully. Jul 11 18:46:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ec362393-df24-4c14-a897-ad7e9540e800 tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-151c7f35-813c-4ecf-a52d-df73e9b1fa2f-delete_volume" released by "delete_volume" :: held 7.414s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:23 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD Jul 11 18:46:23 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:23 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af" returned: 0 in 1.252s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:23 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:46:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:23 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 Jul 11 18:46:23 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:23 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c" returned: 0 in 1.194s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:23 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c Jul 11 18:46:23 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:24 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD" returned: 0 in 1.160s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:24 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Temporary image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 is fetched for user 737ac77957ca41a3b648347f57a75ba0. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:46:24 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[460d93f3-1611-4471-abee-9b9232d3e14c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:24 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD Jul 11 18:46:24 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:24 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c007c53d-2cc4-44cc-b404-cd1d400dc29c" returned: 0 in 0.844s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-quobyte-c007c53d-2cc4-44cc-b404-cd1d400dc29c" released by "delete_volume" :: held 2.115s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:24 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Created reservations ['35599297-fb79-4c07-a89d-77e0a554bea2', '6bac67ce-359f-4891-8323-b4c2a9ce8bc9', '1188e702-a2e5-4025-830e-3d4f16d2dbaa', 'd568f970-b982-4f91-b05d-8e5de9748ca8'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:25 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:46:25 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:25 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD" returned: 0 in 1.644s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:26 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.802s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:26 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:26 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Deleted volume successfully. Jul 11 18:46:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9fee9963-a53e-40a8-9ec2-d21f6aa2780d tempest-VolumesDeleteCascade-1703041302 None] Lock "cinder-c007c53d-2cc4-44cc-b404-cd1d400dc29c-delete_volume" released by "delete_volume" :: held 4.472s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:31 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0" returned: 0 in 7.367s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:31 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a72c6c-2e3d-4557-9076-fc51fe6a6eef]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:31 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af Jul 11 18:46:31 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:32 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af" returned: 0 in 1.343s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:32 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af, size 1024.00 MB, duration 7.37 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:46:32 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Converted 1024.00 MB image at 138.98 MB/s Jul 11 18:46:32 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 is being set with open permissions: ugo+rw Jul 11 18:46:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:32 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 Jul 11 18:46:32 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:33 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0" returned: 0 in 0.689s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-59679d37-44df-4bff-9486-ea71d41f33f0" released by "_copy_volume_from_snapshot" :: held 11.854s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-14809458-80b5-4b2b-b827-a54a236fd54d-59679d37-44df-4bff-9486-ea71d41f33f0" released by "_create_volume_from_snapshot" :: held 11.908s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.927s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.474s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-346721049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aec00d-41d6-474b-9303-969cafde6475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66032e2476f248e0b3e68e04ed06fece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:22Z,use_quota=True,user_id='737ac77957ca41a3b648347f57a75ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Creating volume 91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:33 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:33 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 1073741824 Jul 11 18:46:33 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce42b995-bfd9-4861-a4d9-40774354381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59679d37-44df-4bff-9486-ea71d41f33f0', 'volume_size': 2, 'snapshot_id': '14809458-80b5-4b2b-b827-a54a236fd54d'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78f1010-8751-4156-b154-3b3e26046567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:33 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Volume volume-59679d37-44df-4bff-9486-ea71d41f33f0 (59679d37-44df-4bff-9486-ea71d41f33f0): created successfully Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b78f1010-8751-4156-b154-3b3e26046567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Flow 'volume_create_manager' (3f4c58cf-ed20-450d-882d-73517ce0c0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:33 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ecb6575f-3f20-4c59-b3a8-991f8b271010 tempest-VolumesSnapshotTestJSON-792565178 None] Created volume successfully. Jul 11 18:46:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-59679d37-44df-4bff-9486-ea71d41f33f0-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-59679d37-44df-4bff-9486-ea71d41f33f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-59679d37-44df-4bff-9486-ea71d41f33f0" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-59679d37-44df-4bff-9486-ea71d41f33f0" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:34 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[762e2ea3-ca64-48ce-ac9c-fad10c267718]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:34 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 Jul 11 18:46:34 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:34 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 1073741824" returned: 0 in 1.357s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:34 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 Jul 11 18:46:34 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:35 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0" returned: 0 in 1.066s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:35 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0 Jul 11 18:46:35 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:35 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475" returned: 0 in 0.923s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.352s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:35 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Attempting download of 7016bfdd-2d92-4c05-bebe-d2bb20b14820 ((None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}])) to volume 91aec00d-41d6-474b-9303-969cafde6475. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:46:35 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1572d4e-88ff-4ca5-bbc3-b3657592f2c5]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_e0jt8un5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:35 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_e0jt8un5 Jul 11 18:46:35 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:36 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-59679d37-44df-4bff-9486-ea71d41f33f0" returned: 0 in 0.892s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-59679d37-44df-4bff-9486-ea71d41f33f0" released by "delete_volume" :: held 2.010s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Created reservations ['aebb7433-2624-43b2-aa22-96b243921a9a', 'f938cf86-cee0-4d35-938e-73b8b787c9c4', 'e836b229-6b05-4b7f-84ec-67f5fb00a103', '17de0c9b-549e-4298-a948-0098112516cc'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:36 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:46:36 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-14809458-80b5-4b2b-b827-a54a236fd54d-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-14809458-80b5-4b2b-b827-a54a236fd54d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-5ae8ecee-2f9b-4002-a639-39d836fd49af" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-5ae8ecee-2f9b-4002-a639-39d836fd49af" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-14809458-80b5-4b2b-b827-a54a236fd54d" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-14809458-80b5-4b2b-b827-a54a236fd54d" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Deleting offline snapshot 14809458-80b5-4b2b-b827-a54a236fd54d of volume 5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] snapshot_file for this snap is: volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[45431f5b-e212-44e6-8765-63ef6be63b6c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:36 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d Jul 11 18:46:36 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:37 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_e0jt8un5" returned: 0 in 1.229s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_e0jt8un5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:37 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_e0jt8un5 Jul 11 18:46:37 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:37 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.162s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:37 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:37 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Deleted volume successfully. Jul 11 18:46:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3df5bc46-de64-46c6-bd98-86a2052a2920 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-59679d37-44df-4bff-9486-ea71d41f33f0-delete_volume" released by "delete_volume" :: held 3.584s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:38 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d" returned: 0 in 1.219s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae8ecee-2f9b-4002-a639-39d836fd49af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:46:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1055bfd-217f-4822-81d6-235993b4802a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:38 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af Jul 11 18:46:38 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:38 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_e0jt8un5" returned: 1 in 1.248s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_e0jt8un5' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:46:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1865946d-c5e0-4711-8f8e-3a8b37c59e2a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:38 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD Jul 11 18:46:38 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:39 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af" returned: 0 in 0.947s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:39 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d Jul 11 18:46:39 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:39 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD" returned: 0 in 1.089s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:39 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] 7016bfdd-2d92-4c05-bebe-d2bb20b14820 was qcow2, converting to raw {{(pid=87411) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:46:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:39 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 Jul 11 18:46:39 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:40 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d" returned: 0 in 1.106s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:40 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d Jul 11 18:46:40 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:40 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af.14809458-80b5-4b2b-b827-a54a236fd54d" returned: 0 in 0.838s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-14809458-80b5-4b2b-b827-a54a236fd54d" released by "_delete_snapshot" :: held 4.288s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-5ae8ecee-2f9b-4002-a639-39d836fd49af" released by "delete_snapshot" :: held 4.363s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:41 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Created reservations ['c03741c2-fe3b-42bf-a754-a69f2ed3085f', '8570ce84-37a6-4eed-930f-853f8b483420', 'd55a0971-f580-4fa2-b06b-b1cb6f3410f8', 'a7ba2fe4-f69e-4e64-8395-10f19ceaff67'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:41 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Delete snapshot completed successfully. Jul 11 18:46:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56b697b3-bd74-4384-9304-2d3fa863ab44 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-14809458-80b5-4b2b-b827-a54a236fd54d-delete_snapshot" released by "delete_snapshot" :: held 4.596s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:41 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475" returned: 0 in 2.300s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:41 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_ohf53mfsdevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:46:41 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Converted 112.00 MB image at 48.67 MB/s Jul 11 18:46:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:41 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 1G Jul 11 18:46:41 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-5ae8ecee-2f9b-4002-a639-39d836fd49af-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-5ae8ecee-2f9b-4002-a639-39d836fd49af-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-5ae8ecee-2f9b-4002-a639-39d836fd49af" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-5ae8ecee-2f9b-4002-a639-39d836fd49af" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb4600d-693a-434f-bd3c-bd9ac09af6e8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:42 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af Jul 11 18:46:42 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:42 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 1G" returned: 0 in 0.820s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7c21d5-265e-4226-a281-5bf0482d8fee]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:42 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 Jul 11 18:46:42 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:43 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af" returned: 0 in 0.781s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:43 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af Jul 11 18:46:43 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:43 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475" returned: 0 in 0.816s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:43 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 Jul 11 18:46:43 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:43 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5ae8ecee-2f9b-4002-a639-39d836fd49af" returned: 0 in 0.790s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-5ae8ecee-2f9b-4002-a639-39d836fd49af" released by "delete_volume" :: held 1.646s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:43 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Created reservations ['b782ba7a-895e-4be7-adf6-6621d5ece036', '6e3a7185-4e18-4d4d-96f5-70f08c804f48', '2332bb10-5ca6-4b8f-8654-38da47f3e2ca', '596a8644-bfa7-4160-a9c4-f20cd60f576c'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:44 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:46:44 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:44 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475" returned: 1 in 0.890s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Downloaded image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 ((None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}])) to volume 91aec00d-41d6-474b-9303-969cafde6475 successfully. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Temporary image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 for user 737ac77957ca41a3b648347f57a75ba0 is deleted. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Marking volume 91aec00d-41d6-474b-9303-969cafde6475 as bootable. {{(pid=87411) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Copying metadata from image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 to 91aec00d-41d6-474b-9303-969cafde6475. {{(pid=87411) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Creating volume glance metadata for volume 91aec00d-41d6-474b-9303-969cafde6475 backed by image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87411) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceeab3a0-c2d0-4c3f-a6d8-48e14e5cbe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91aec00d-41d6-474b-9303-969cafde6475', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12ea96-b5a9-492b-a00b-f7064758f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:44 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Volume volume-91aec00d-41d6-474b-9303-969cafde6475 (91aec00d-41d6-474b-9303-969cafde6475): created successfully Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe12ea96-b5a9-492b-a00b-f7064758f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Flow 'volume_create_manager' (38b8ffd6-2201-493f-9d5c-9b1832b1608e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-72faef15-4fa3-41c9-9d5c-b1cb2645bb7a tempest-VolumesExtendTest-1763079492 None] Created volume successfully. Jul 11 18:46:44 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.946s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:44 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Deleted volume successfully. Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4c1d8310-b0e3-44a6-9b4e-592347d77b71 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-5ae8ecee-2f9b-4002-a639-39d836fd49af-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Flow 'volume_create_manager' (b9a6733e-48df-420a-9382-9bad136e4ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f97770-bf1c-4af8-9869-4e4ff90b51a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f97770-bf1c-4af8-9869-4e4ff90b51a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1365728065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da8d6da-4540-4d0f-b039-cb382f129403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341298d06d8e4d5fb08f3ad1acb6f0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:45Z,use_quota=True,user_id='d87e382510a24e609daa43f4dc7b1e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088d5e3d-d7ca-4cc7-90d6-4419cda2a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088d5e3d-d7ca-4cc7-90d6-4419cda2a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df23f1b-52cc-435c-8707-cd63460fe36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df23f1b-52cc-435c-8707-cd63460fe36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1da8d6da-4540-4d0f-b039-cb382f129403', 'volume_name': 'volume-1da8d6da-4540-4d0f-b039-cb382f129403', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f073975a-6c5c-4bac-aa8d-d28caf75899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f073975a-6c5c-4bac-aa8d-d28caf75899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e919df-8f8f-4d92-9190-08f70aec47d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:45 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Volume 1da8d6da-4540-4d0f-b039-cb382f129403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1da8d6da-4540-4d0f-b039-cb382f129403', 'volume_size': 1} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1365728065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da8d6da-4540-4d0f-b039-cb382f129403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341298d06d8e4d5fb08f3ad1acb6f0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:45Z,use_quota=True,user_id='d87e382510a24e609daa43f4dc7b1e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Creating volume 1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:45 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:45 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 1073741824 Jul 11 18:46:45 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:45 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Flow 'volume_create_manager' (8169016c-222c-45ca-a4ff-353b76f54fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5d2a8e-f479-4198-af35-aaba8197d376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5d2a8e-f479-4198-af35-aaba8197d376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1266203452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cd848c-eaa4-4587-851f-5f7dff654674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0bfc567a5c42678863113bd5d339c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:46Z,use_quota=True,user_id='3cc0e261e5d3460aafa70d3a20103f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ba4810-297b-4605-bafa-14c9c5749dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ba4810-297b-4605-bafa-14c9c5749dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbb848f-fc29-4b5f-99df-0dfb66f6e5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbb848f-fc29-4b5f-99df-0dfb66f6e5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cd848c-eaa4-4587-851f-5f7dff654674', 'volume_name': 'volume-55cd848c-eaa4-4587-851f-5f7dff654674', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb730195-41c9-4329-8667-a36378685c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb730195-41c9-4329-8667-a36378685c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d449ca5-6ada-43c0-a787-dfb5e081f1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:46 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Volume 55cd848c-eaa4-4587-851f-5f7dff654674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cd848c-eaa4-4587-851f-5f7dff654674', 'volume_size': 1} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:46 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 1073741824" returned: 0 in 1.030s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:46 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 Jul 11 18:46:46 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:47 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403" returned: 0 in 0.651s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.108s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e919df-8f8f-4d92-9190-08f70aec47d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da8d6da-4540-4d0f-b039-cb382f129403', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299e78a8-688e-4df4-9252-089d50636a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a530182c-5501-4dca-8acc-9618a61c48c9]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:47 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Volume volume-1da8d6da-4540-4d0f-b039-cb382f129403 (1da8d6da-4540-4d0f-b039-cb382f129403): created successfully Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299e78a8-688e-4df4-9252-089d50636a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Flow 'volume_create_manager' (b9a6733e-48df-420a-9382-9bad136e4ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-68ac96e7-1990-4ee0-bbf7-371dac7dbf3b tempest-VolumesSnapshotTestJSON-792565178 None] Created volume successfully. Jul 11 18:46:47 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 Jul 11 18:46:47 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:47 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475" returned: 0 in 0.790s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:47 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 Jul 11 18:46:47 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:48 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475" returned: 1 in 0.742s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 2G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 2G" returned: 0 in 0.057s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.637s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.571s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1266203452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cd848c-eaa4-4587-851f-5f7dff654674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a0bfc567a5c42678863113bd5d339c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:46Z,use_quota=True,user_id='3cc0e261e5d3460aafa70d3a20103f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Creating volume 55cd848c-eaa4-4587-851f-5f7dff654674 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:48 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:46:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:48 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 1073741824 Jul 11 18:46:48 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:48 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e6ca47fa-8ea4-4ec5-85c6-8d6adc2edd37 tempest-VolumesExtendTest-1763079492 None] Extend volume completed successfully. Jul 11 18:46:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Acquiring lock "cinder-91aec00d-41d6-474b-9303-969cafde6475-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Lock "cinder-91aec00d-41d6-474b-9303-969cafde6475-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Acquiring lock "cinder-quobyte-91aec00d-41d6-474b-9303-969cafde6475" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Lock "cinder-quobyte-91aec00d-41d6-474b-9303-969cafde6475" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:49 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[16307a8c-409b-4f2a-b493-7cdb14142c72]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:49 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 Jul 11 18:46:49 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:49 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 1073741824" returned: 0 in 0.846s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:49 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 Jul 11 18:46:49 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:50 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475" returned: 0 in 0.758s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:50 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 Jul 11 18:46:50 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:50 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674" returned: 0 in 0.651s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.739s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Creating offline snapshot 1843fa30-ff2a-4e3c-b8e9-f96d243bc54b of volume 1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d449ca5-6ada-43c0-a787-dfb5e081f1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cd848c-eaa4-4587-851f-5f7dff654674', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c88266f-b8c3-4c73-a99a-0fbb3f19ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[03232ee6-2b18-47d3-9e91-9ba6120fab1a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Volume volume-55cd848c-eaa4-4587-851f-5f7dff654674 (55cd848c-eaa4-4587-851f-5f7dff654674): created successfully Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c88266f-b8c3-4c73-a99a-0fbb3f19ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Flow 'volume_create_manager' (8169016c-222c-45ca-a4ff-353b76f54fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:50 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-45de0cc7-8999-4565-a0bc-6fca450ca746 tempest-VolumesActionsTest-440279884 None] Created volume successfully. Jul 11 18:46:50 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 Jul 11 18:46:50 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:50 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475" returned: 1 in 0.754s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:46:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:50 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475 Jul 11 18:46:50 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:51 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403" returned: 0 in 0.792s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:51 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b 1G Jul 11 18:46:51 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:51 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:46:51 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:51 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-91aec00d-41d6-474b-9303-969cafde6475" returned: 0 in 0.697s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Lock "cinder-quobyte-91aec00d-41d6-474b-9303-969cafde6475" released by "delete_volume" :: held 2.279s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=99,cinder:INSERT=31,cinder:UPDATE=103,cinder:DELETE=9 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Created reservations ['814660c7-3b41-4ced-b1ca-bc929ebdd38b', '5d459aad-35f8-420f-84d1-4dc46f2e0292', '49b9e052-3ec5-4c31-8ea1-3123af08d99b', '0d5aadcd-03ae-41c4-9546-1ee4c72caa62'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:51 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:46:51 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:52 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b 1G" returned: 0 in 0.995s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1da8d6da-4540-4d0f-b039-cb382f129403 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:52 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1da8d6da-4540-4d0f-b039-cb382f129403 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b Jul 11 18:46:52 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:52 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.816s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:46:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:46:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:46:52 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.991s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:46:52 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Deleted volume successfully. Jul 11 18:46:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bf3880a9-8902-4002-a71e-8eb5bc97935d tempest-VolumesExtendTest-1763079492 None] Lock "cinder-91aec00d-41d6-474b-9303-969cafde6475-delete_volume" released by "delete_volume" :: held 3.547s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:46:53 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1da8d6da-4540-4d0f-b039-cb382f129403 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b" returned: 0 in 1.073s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:53 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b is being set with open permissions: ugo+rw Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:53 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b Jul 11 18:46:53 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Flow 'volume_create_manager' (af542550-70f2-436a-a18e-d6f2df932fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467a0324-993d-4662-8ccd-bd8a9908001c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467a0324-993d-4662-8ccd-bd8a9908001c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-362385314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aff72f6-666f-4217-b129-b145bebf778a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66032e2476f248e0b3e68e04ed06fece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:53Z,use_quota=True,user_id='737ac77957ca41a3b648347f57a75ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd775dc9-246d-43b3-9b76-e1f59bf67687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd775dc9-246d-43b3-9b76-e1f59bf67687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11761488-9a63-4c17-9222-2183e47b385c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11761488-9a63-4c17-9222-2183e47b385c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aff72f6-666f-4217-b129-b145bebf778a', 'volume_name': 'volume-2aff72f6-666f-4217-b129-b145bebf778a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4421711e-1799-4cd8-8fc2-a7ababdef57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4421711e-1799-4cd8-8fc2-a7ababdef57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfa4d18-78cf-4c7a-9787-e625f707360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:53 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Volume 2aff72f6-666f-4217-b129-b145bebf778a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aff72f6-666f-4217-b129-b145bebf778a', 'volume_size': 1} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Flow 'volume_create_manager' (9380a1f7-0108-484e-b8d8-ae42d78afce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c685947-2a23-4e28-9701-11c11bf57309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c685947-2a23-4e28-9701-11c11bf57309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-376364083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf13309-a724-4745-973a-307d59a316ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bbc3fcd5a4b2da73005b44c40cf9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:53Z,use_quota=True,user_id='05e5847e57504277b3c454319772c073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a79216b-e4ff-4ad3-8a33-dbbe24169f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a79216b-e4ff-4ad3-8a33-dbbe24169f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a638596-6054-40eb-8183-34a9605aa9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a638596-6054-40eb-8183-34a9605aa9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf13309-a724-4745-973a-307d59a316ff', 'volume_name': 'volume-caf13309-a724-4745-973a-307d59a316ff', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e295a0f-a3fb-4958-bd4d-111f36b94c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e295a0f-a3fb-4958-bd4d-111f36b94c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf036823-32fd-4227-9dfd-2e297a44b7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:53 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Volume caf13309-a724-4745-973a-307d59a316ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf13309-a724-4745-973a-307d59a316ff', 'volume_size': 1} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:53 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b" returned: 0 in 0.675s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:53 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.info Jul 11 18:46:53 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:54 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.info" returned: 0 in 0.652s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:54 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.info is being set with open permissions: ugo+rw Jul 11 18:46:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:54 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.info Jul 11 18:46:54 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:55 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.info" returned: 0 in 0.636s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.927s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-362385314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aff72f6-666f-4217-b129-b145bebf778a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66032e2476f248e0b3e68e04ed06fece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:53Z,use_quota=True,user_id='737ac77957ca41a3b648347f57a75ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Creating volume 2aff72f6-666f-4217-b129-b145bebf778a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:55 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:55 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a 1073741824 Jul 11 18:46:55 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1db5fcd7-f4ee-4b0b-a211-f15a431d7794 tempest-VolumesSnapshotTestJSON-792565178 None] Create snapshot completed successfully Jul 11 18:46:55 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a 1073741824" returned: 0 in 0.837s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:56 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a Jul 11 18:46:56 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:56 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a" returned: 0 in 0.692s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.033s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-376364083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf13309-a724-4745-973a-307d59a316ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bbc3fcd5a4b2da73005b44c40cf9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:53Z,use_quota=True,user_id='05e5847e57504277b3c454319772c073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Creating volume caf13309-a724-4745-973a-307d59a316ff {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:56 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:56 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff 1073741824 Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfa4d18-78cf-4c7a-9787-e625f707360a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aff72f6-666f-4217-b129-b145bebf778a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:56 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aa9f3e-7488-484a-805b-88b26889504a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:56 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Volume volume-2aff72f6-666f-4217-b129-b145bebf778a (2aff72f6-666f-4217-b129-b145bebf778a): created successfully Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aa9f3e-7488-484a-805b-88b26889504a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Flow 'volume_create_manager' (af542550-70f2-436a-a18e-d6f2df932fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:46:56 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f3f25c74-615c-40a4-84df-e8c999e98083 tempest-VolumesExtendTest-1763079492 None] Created volume successfully. Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Flow 'volume_create_manager' (835634da-66dd-43cc-a8e2-62efad82f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157b6182-ad9a-45c2-b667-96786fe53c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157b6182-ad9a-45c2-b667-96786fe53c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-664765565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80abc85f-af62-43b6-9848-a6067d8f31b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='341298d06d8e4d5fb08f3ad1acb6f0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1843fa30-ff2a-4e3c-b8e9-f96d243bc54b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:46:57Z,use_quota=True,user_id='d87e382510a24e609daa43f4dc7b1e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20904f5a-474e-4517-af0e-d468ed220879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20904f5a-474e-4517-af0e-d468ed220879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adddbc93-ace1-4bb2-9f25-29228e22ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adddbc93-ace1-4bb2-9f25-29228e22ba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '80abc85f-af62-43b6-9848-a6067d8f31b0', 'volume_name': 'volume-80abc85f-af62-43b6-9848-a6067d8f31b0', 'volume_size': 1, 'snapshot_id': '1843fa30-ff2a-4e3c-b8e9-f96d243bc54b'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a38fc82-06ee-49e0-a834-f7819b06682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a38fc82-06ee-49e0-a834-f7819b06682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074429a9-b1c0-4511-b013-3937381e853c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:56 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Volume 80abc85f-af62-43b6-9848-a6067d8f31b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-80abc85f-af62-43b6-9848-a6067d8f31b0', 'volume_size': 1, 'snapshot_id': '1843fa30-ff2a-4e3c-b8e9-f96d243bc54b'} Jul 11 18:46:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:57 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff 1073741824" returned: 0 in 0.889s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:57 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff Jul 11 18:46:57 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:58 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff" returned: 0 in 0.671s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.419s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-1843fa30-ff2a-4e3c-b8e9-f96d243bc54b-80abc85f-af62-43b6-9848-a6067d8f31b0" by "_create_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf036823-32fd-4227-9dfd-2e297a44b7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf13309-a724-4745-973a-307d59a316ff', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675a42d5-c8b9-4f16-b1d9-dd0e4df94572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-1843fa30-ff2a-4e3c-b8e9-f96d243bc54b-80abc85f-af62-43b6-9848-a6067d8f31b0" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Creating volume 80abc85f-af62-43b6-9848-a6067d8f31b0 from snapshot 1843fa30-ff2a-4e3c-b8e9-f96d243bc54b {{(pid=87411) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-80abc85f-af62-43b6-9848-a6067d8f31b0" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:46:58 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Volume volume-caf13309-a724-4745-973a-307d59a316ff (caf13309-a724-4745-973a-307d59a316ff): created successfully Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675a42d5-c8b9-4f16-b1d9-dd0e4df94572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Flow 'volume_create_manager' (9380a1f7-0108-484e-b8d8-ae42d78afce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-80abc85f-af62-43b6-9848-a6067d8f31b0" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] snapshot: 1843fa30-ff2a-4e3c-b8e9-f96d243bc54b, volume: 80abc85f-af62-43b6-9848-a6067d8f31b0, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:46:58 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1ed2098f-6e81-4e10-8133-ebbc6c5f6064 tempest-AttachVolumeTestJSON-365977217 None] Created volume successfully. Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ac4fed-6351-4982-8be5-9afdebfeef0c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:58 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b Jul 11 18:46:58 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:46:59 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 11 18:46:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b" returned: 0 in 0.888s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:46:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1da8d6da-4540-4d0f-b039-cb382f129403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:46:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:46:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:46:59 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[373a7aea-0f33-49a0-9ed6-1d041395ef93]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:46:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:46:59 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 Jul 11 18:46:59 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:00 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403" returned: 0 in 0.810s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:00 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:47:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:00 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 Jul 11 18:47:00 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-e16b6b9e-873f-497e-80cd-c7ff06fc886e req-8f6e6a52-494d-4850-ac9c-9c14972feda0 tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:05 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0" returned: 0 in 5.689s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:05 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[678914a7-cc53-4695-a643-ad0d1074a138]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:06 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 Jul 11 18:47:06 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:06 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403" returned: 0 in 1.030s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:06 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:47:06 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Converted 1024.00 MB image at 179.98 MB/s Jul 11 18:47:06 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 is being set with open permissions: ugo+rw Jul 11 18:47:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:06 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 Jul 11 18:47:06 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:07 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0" returned: 0 in 0.682s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-80abc85f-af62-43b6-9848-a6067d8f31b0" released by "_copy_volume_from_snapshot" :: held 9.224s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-1843fa30-ff2a-4e3c-b8e9-f96d243bc54b-80abc85f-af62-43b6-9848-a6067d8f31b0" released by "_create_volume_from_snapshot" :: held 9.274s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.310s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.015s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Creating offline snapshot 946e37c5-a0fd-4910-a2d8-198d07f7b827 of volume 2aff72f6-666f-4217-b129-b145bebf778a {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074429a9-b1c0-4511-b013-3937381e853c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80abc85f-af62-43b6-9848-a6067d8f31b0', 'volume_size': 1, 'snapshot_id': '1843fa30-ff2a-4e3c-b8e9-f96d243bc54b'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f44a49-9baa-41c1-b577-0fc37d2dee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d906d5-c3d1-4468-8a40-7fc67f3fbea4]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:07 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Volume volume-80abc85f-af62-43b6-9848-a6067d8f31b0 (80abc85f-af62-43b6-9848-a6067d8f31b0): created successfully Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f44a49-9baa-41c1-b577-0fc37d2dee82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Flow 'volume_create_manager' (835634da-66dd-43cc-a8e2-62efad82f605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-526499d3-1147-4084-acaf-86f6c10bc626 tempest-VolumesSnapshotTestJSON-792565178 None] Created volume successfully. Jul 11 18:47:07 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a Jul 11 18:47:07 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:08 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a" returned: 0 in 0.852s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:08 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 1G Jul 11 18:47:08 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-80abc85f-af62-43b6-9848-a6067d8f31b0-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-80abc85f-af62-43b6-9848-a6067d8f31b0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-80abc85f-af62-43b6-9848-a6067d8f31b0" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-80abc85f-af62-43b6-9848-a6067d8f31b0" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:09 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e90269-bc4a-4945-b542-a5bc377c6900]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:09 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 Jul 11 18:47:09 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f5f92747-3214-40a6-9294-4ba5947f4f16 tempest-VolumesActionsTest-440279884 None] Acquiring lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674" by "attach_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:09 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 1G" returned: 0 in 0.994s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aff72f6-666f-4217-b129-b145bebf778a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f5f92747-3214-40a6-9294-4ba5947f4f16 tempest-VolumesActionsTest-440279884 None] Lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674" acquired by "attach_volume" :: waited 0.039s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:09 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aff72f6-666f-4217-b129-b145bebf778a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 Jul 11 18:47:09 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:09 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f5f92747-3214-40a6-9294-4ba5947f4f16 tempest-VolumesActionsTest-440279884 None] Attaching volume 55cd848c-eaa4-4587-851f-5f7dff654674 to instance 85bba720-9530-4dfe-b347-c7a431acdfeb at mountpoint /dev/vdb on host None. Jul 11 18:47:09 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f5f92747-3214-40a6-9294-4ba5947f4f16 tempest-VolumesActionsTest-440279884 None] Attach volume completed successfully. Jul 11 18:47:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f5f92747-3214-40a6-9294-4ba5947f4f16 tempest-VolumesActionsTest-440279884 None] Lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674" released by "attach_volume" :: held 0.115s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:10 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0" returned: 0 in 0.935s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:10 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0 Jul 11 18:47:10 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d38b7b50-1c87-420f-abfd-c1368e06f91d tempest-VolumesActionsTest-440279884 None] Acquiring lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674-detach_volume" by "detach_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d38b7b50-1c87-420f-abfd-c1368e06f91d tempest-VolumesActionsTest-440279884 None] Lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:10 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d38b7b50-1c87-420f-abfd-c1368e06f91d tempest-VolumesActionsTest-440279884 None] Detaching volume 55cd848c-eaa4-4587-851f-5f7dff654674 from instance 85bba720-9530-4dfe-b347-c7a431acdfeb. Jul 11 18:47:10 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d38b7b50-1c87-420f-abfd-c1368e06f91d tempest-VolumesActionsTest-440279884 None] Detach volume completed successfully. Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d38b7b50-1c87-420f-abfd-c1368e06f91d tempest-VolumesActionsTest-440279884 None] Lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:10 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aff72f6-666f-4217-b129-b145bebf778a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827" returned: 0 in 0.890s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:10 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 is being set with open permissions: ugo+rw Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:10 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 Jul 11 18:47:10 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:10 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-80abc85f-af62-43b6-9848-a6067d8f31b0" returned: 0 in 0.745s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-80abc85f-af62-43b6-9848-a6067d8f31b0" released by "delete_volume" :: held 1.755s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Created reservations ['bfc99dec-68eb-4de3-b49c-206ef5dc7754', 'f3ceef8e-3912-4d00-8e59-f05dc08cb34c', '555ac477-6997-449f-b826-abc593b50e77', '1a006c01-45b7-4758-a2cb-72a9b87c4c5e'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:10 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:47:10 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:11 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827" returned: 0 in 0.774s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-1843fa30-ff2a-4e3c-b8e9-f96d243bc54b-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:11 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.info Jul 11 18:47:11 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-1843fa30-ff2a-4e3c-b8e9-f96d243bc54b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-1da8d6da-4540-4d0f-b039-cb382f129403" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-1da8d6da-4540-4d0f-b039-cb382f129403" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-1843fa30-ff2a-4e3c-b8e9-f96d243bc54b" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-1843fa30-ff2a-4e3c-b8e9-f96d243bc54b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Deleting offline snapshot 1843fa30-ff2a-4e3c-b8e9-f96d243bc54b of volume 1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] snapshot_file for this snap is: volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[df65be88-e093-41e4-b5a1-058815ecacfd]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:11 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b Jul 11 18:47:11 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:11 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.988s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:47:11 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Deleted volume successfully. Jul 11 18:47:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7a01798-6840-4feb-9f23-53fea29a8718 tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-80abc85f-af62-43b6-9848-a6067d8f31b0-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:12 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.info" returned: 0 in 0.906s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:12 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.info is being set with open permissions: ugo+rw Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:12 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.info Jul 11 18:47:12 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:12 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b" returned: 0 in 0.949s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1da8d6da-4540-4d0f-b039-cb382f129403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a0e0aa-8c32-4722-aebf-31e9a626726d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:12 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 Jul 11 18:47:12 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:12 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.info" returned: 0 in 0.644s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.189s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-e16b6b9e-873f-497e-80cd-c7ff06fc886e req-8f6e6a52-494d-4850-ac9c-9c14972feda0 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.691s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28de552-1668-4348-bbef-cedf049268f7]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-e16b6b9e-873f-497e-80cd-c7ff06fc886e req-8f6e6a52-494d-4850-ac9c-9c14972feda0 tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:12 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b6c3f502-6979-40b5-88ff-73573dd51344 tempest-VolumesExtendTest-1763079492 None] Create snapshot completed successfully Jul 11 18:47:13 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff Jul 11 18:47:13 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:13 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403" returned: 0 in 0.947s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:13 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b Jul 11 18:47:13 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:13 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-e16b6b9e-873f-497e-80cd-c7ff06fc886e req-8f6e6a52-494d-4850-ac9c-9c14972feda0 tempest-AttachVolumeTestJSON-365977217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff" returned: 0 in 0.956s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-e16b6b9e-873f-497e-80cd-c7ff06fc886e req-8f6e6a52-494d-4850-ac9c-9c14972feda0 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.013s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:13 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:INSERT=40,cinder:SELECT=86,cinder:UPDATE=95,cinder:DELETE=8 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:47:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-e16b6b9e-873f-497e-80cd-c7ff06fc886e req-8f6e6a52-494d-4850-ac9c-9c14972feda0 tempest-AttachVolumeTestJSON-365977217 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-caf13309-a724-4745-973a-307d59a316ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f8c3dba-45e3-454c-828c-7e67992b15cf', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:47:14 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-e16b6b9e-873f-497e-80cd-c7ff06fc886e req-8f6e6a52-494d-4850-ac9c-9c14972feda0 tempest-AttachVolumeTestJSON-365977217 None] attachment_update completed successfully. Jul 11 18:47:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bdcccbf0-7d4e-42cf-b7d9-ed3acebf8fa6 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bdcccbf0-7d4e-42cf-b7d9-ed3acebf8fa6 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:14 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a4d83-1cdc-4409-bebb-d4321e0d2d75]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bdcccbf0-7d4e-42cf-b7d9-ed3acebf8fa6 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:14 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b" returned: 0 in 0.849s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:14 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b Jul 11 18:47:14 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:14 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a Jul 11 18:47:14 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:15 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bdcccbf0-7d4e-42cf-b7d9-ed3acebf8fa6 tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a" returned: 0 in 0.777s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:15 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bdcccbf0-7d4e-42cf-b7d9-ed3acebf8fa6 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 2G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403.1843fa30-ff2a-4e3c-b8e9-f96d243bc54b" returned: 0 in 0.784s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-1843fa30-ff2a-4e3c-b8e9-f96d243bc54b" released by "_delete_snapshot" :: held 3.703s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-1da8d6da-4540-4d0f-b039-cb382f129403" released by "delete_snapshot" :: held 3.748s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Created reservations ['2f9d960d-60e8-4c89-bbb9-814471ec86a0', 'b1c45af4-2912-49c2-b319-ca785eb7490b', '7e3c7ff5-844a-43d1-b481-43f411b9e868', 'e2074f9d-4deb-42da-8bde-66f537befec4'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bdcccbf0-7d4e-42cf-b7d9-ed3acebf8fa6 tempest-VolumesExtendTest-1763079492 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 2G" returned: 0 in 0.240s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bdcccbf0-7d4e-42cf-b7d9-ed3acebf8fa6 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.058s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Delete snapshot completed successfully. Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a1a453bb-f3af-4c7c-9a54-5255c40cc4cd tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-1843fa30-ff2a-4e3c-b8e9-f96d243bc54b-delete_snapshot" released by "delete_snapshot" :: held 3.984s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-bdcccbf0-7d4e-42cf-b7d9-ed3acebf8fa6 tempest-VolumesExtendTest-1763079492 None] Extend volume completed successfully. Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-1da8d6da-4540-4d0f-b039-cb382f129403-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-1da8d6da-4540-4d0f-b039-cb382f129403-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-1da8d6da-4540-4d0f-b039-cb382f129403" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-1da8d6da-4540-4d0f-b039-cb382f129403" acquired by "delete_volume" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f9743f-42c7-449e-8fb4-a1ed0c259748]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:15 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 Jul 11 18:47:15 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "cinder-946e37c5-a0fd-4910-a2d8-198d07f7b827-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Lock "cinder-946e37c5-a0fd-4910-a2d8-198d07f7b827-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "cinder-quobyte-2aff72f6-666f-4217-b129-b145bebf778a" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Lock "cinder-quobyte-2aff72f6-666f-4217-b129-b145bebf778a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "cinder-quobyte-946e37c5-a0fd-4910-a2d8-198d07f7b827" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Lock "cinder-quobyte-946e37c5-a0fd-4910-a2d8-198d07f7b827" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Deleting offline snapshot 946e37c5-a0fd-4910-a2d8-198d07f7b827 of volume 2aff72f6-666f-4217-b129-b145bebf778a {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:47:16 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] snapshot_file for this snap is: volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403" returned: 0 in 0.803s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8135a58-9a85-4562-affd-29322fd365ac]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:16 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403 Jul 11 18:47:16 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:16 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 Jul 11 18:47:16 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:17 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1da8d6da-4540-4d0f-b039-cb382f129403" returned: 0 in 0.747s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-1da8d6da-4540-4d0f-b039-cb382f129403" released by "delete_volume" :: held 1.616s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:17 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827" returned: 0 in 0.775s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aff72f6-666f-4217-b129-b145bebf778a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae4731-2477-44d6-a5de-03f8f2d62983]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Created reservations ['6f22e2db-956b-425c-ad76-9021f8857440', '0daa6612-f0b0-494c-b7be-3bccc3c7c782', '3c551867-21a6-4cd4-98bf-1c95d22ddcf6', '6c731edb-0a23-4713-be12-f5bfcb8fb708'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:17 devstack sudo[95176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a Jul 11 18:47:17 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:17 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:47:17 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-8134bf68-7ac7-4d25-aa8d-0bfa996d4723-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-8134bf68-7ac7-4d25-aa8d-0bfa996d4723-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "cinder-quobyte-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" acquired by "delete_volume" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f45dc58-3d8a-4f90-8e81-624337f32ca7]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:18 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.816s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:47:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Deleted volume successfully. Jul 11 18:47:18 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 Jul 11 18:47:18 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0d2b3d2f-4ecf-4189-a253-5369763c8fbb tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-1da8d6da-4540-4d0f-b039-cb382f129403-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:18 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a" returned: 0 in 1.048s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:18 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 Jul 11 18:47:18 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:19 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" returned: 0 in 0.933s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:19 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723 Jul 11 18:47:19 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:19 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827" returned: 0 in 0.978s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:19 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827 Jul 11 18:47:19 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:19 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" returned: 0 in 0.745s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-quobyte-8134bf68-7ac7-4d25-aa8d-0bfa996d4723" released by "delete_volume" :: held 1.746s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Created reservations ['8ad1c5e3-fbee-4bd6-998e-a46517222095', 'f35ac367-7e9d-43af-91b5-6192d27f5ef6', 'f84063de-e0e5-4842-8843-f9f5947938a8', 'f0978d53-0ad3-4af4-b79a-509628e5490e'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:20 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:47:20 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:20 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a.946e37c5-a0fd-4910-a2d8-198d07f7b827" returned: 0 in 0.683s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Lock "cinder-quobyte-946e37c5-a0fd-4910-a2d8-198d07f7b827" released by "_delete_snapshot" :: held 3.611s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Lock "cinder-quobyte-2aff72f6-666f-4217-b129-b145bebf778a" released by "delete_snapshot" :: held 3.636s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Created reservations ['12665013-d694-496a-ba8e-875940630d7f', '3189e449-c47e-4ac6-af1c-ec1a6c597206', '7342a6f9-fd37-4b68-9321-665181b7d449', 'f113513a-9c47-4e78-86a3-6a9e3e3b3bf0'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Delete snapshot completed successfully. Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1807005b-5d85-4faa-a869-9619e935e2c6 tempest-VolumesExtendTest-1763079492 None] Lock "cinder-946e37c5-a0fd-4910-a2d8-198d07f7b827-delete_snapshot" released by "delete_snapshot" :: held 3.798s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.654s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:47:20 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Deleted volume successfully. Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08408204-dbc9-4da0-956c-fc5839fa2e5a tempest-VolumesSnapshotTestJSON-792565178 None] Lock "cinder-8134bf68-7ac7-4d25-aa8d-0bfa996d4723-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "cinder-2aff72f6-666f-4217-b129-b145bebf778a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Lock "cinder-2aff72f6-666f-4217-b129-b145bebf778a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "cinder-quobyte-2aff72f6-666f-4217-b129-b145bebf778a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Lock "cinder-quobyte-2aff72f6-666f-4217-b129-b145bebf778a" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:21 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd56364c-8136-4a7d-bab8-6013dfa93c91]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:21 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a Jul 11 18:47:21 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:21 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a" returned: 0 in 0.834s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:21 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a Jul 11 18:47:21 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:22 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2aff72f6-666f-4217-b129-b145bebf778a" returned: 0 in 0.784s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Lock "cinder-quobyte-2aff72f6-666f-4217-b129-b145bebf778a" released by "delete_volume" :: held 1.686s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:22 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Created reservations ['634dab79-3d89-4e3b-a1a8-cfee6c35b5b2', '96c493d0-1464-4779-bfe6-2f3a771d2626', 'a2c618c9-9011-4dc5-a0c9-ad9e47faf1a1', '35dc22da-2703-4cb9-9e74-d1b17ac3ae2c'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:47:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:22 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:47:22 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:23 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.029s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:23 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:47:23 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Deleted volume successfully. Jul 11 18:47:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-56e6db1e-3725-4213-a376-69f8775dd7e2 tempest-VolumesExtendTest-1763079492 None] Lock "cinder-2aff72f6-666f-4217-b129-b145bebf778a-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Flow 'volume_create_manager' (deba2d99-8704-46f3-b59c-1c145a51ed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b04d76-96f6-4360-8106-436f701a129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b04d76-96f6-4360-8106-436f701a129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2031176123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd8be77-fa24-47f2-ad60-c7e1dc0bef10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420fffb88745481a8be9d7b00951ad40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:47:28Z,use_quota=True,user_id='756bae70746047428064ea0eb37ac49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c347f7d-71ed-4961-bea2-69f9041113f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c347f7d-71ed-4961-bea2-69f9041113f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7938ac-644c-4d5c-80f2-d60db8f68791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7938ac-644c-4d5c-80f2-d60db8f68791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd8be77-fa24-47f2-ad60-c7e1dc0bef10', 'volume_name': 'volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d043ad6-637f-463c-8188-0496c7046b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d043ad6-637f-463c-8188-0496c7046b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49fafc19-84be-47bd-8141-be2460db83d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:27 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Volume 2bd8be77-fa24-47f2-ad60-c7e1dc0bef10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10', 'volume_size': 1} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2031176123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd8be77-fa24-47f2-ad60-c7e1dc0bef10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420fffb88745481a8be9d7b00951ad40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:47:28Z,use_quota=True,user_id='756bae70746047428064ea0eb37ac49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Creating volume 2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:47:27 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:47:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:27 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 1073741824 Jul 11 18:47:27 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Flow 'volume_create_manager' (fabc2c3c-eac9-4782-99ef-7e57c68461ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cc63c9-5eaf-4611-b1c2-cb67840ea9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cc63c9-5eaf-4611-b1c2-cb67840ea9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1264466043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c474653c-d3b2-4aab-956b-574fcfe8ead7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dff6aa16c514216b1a7675d939fc390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:47:28Z,use_quota=True,user_id='11d20373007e4248819667909336247c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7607e6-6c82-41a8-af9a-6476d4851e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7607e6-6c82-41a8-af9a-6476d4851e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b573628-6836-4923-b841-28c359a83145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b573628-6836-4923-b841-28c359a83145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c474653c-d3b2-4aab-956b-574fcfe8ead7', 'volume_name': 'volume-c474653c-d3b2-4aab-956b-574fcfe8ead7', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a70993-7d4e-4310-a36b-bbfa81acfd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a70993-7d4e-4310-a36b-bbfa81acfd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a1006d-6cef-45dd-9aff-bd65cfbd5523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:28 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Volume c474653c-d3b2-4aab-956b-574fcfe8ead7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c474653c-d3b2-4aab-956b-574fcfe8ead7', 'volume_size': 1} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:28 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 1073741824" returned: 0 in 0.920s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:28 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 Jul 11 18:47:28 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:29 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10" returned: 0 in 1.003s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1264466043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c474653c-d3b2-4aab-956b-574fcfe8ead7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dff6aa16c514216b1a7675d939fc390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:47:28Z,use_quota=True,user_id='11d20373007e4248819667909336247c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Creating volume c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:47:29 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:29 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 1073741824 Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49fafc19-84be-47bd-8141-be2460db83d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:29 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89f0065-c89d-453d-9637-e30b64048db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:30 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Volume volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 (2bd8be77-fa24-47f2-ad60-c7e1dc0bef10): created successfully Jul 11 18:47:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89f0065-c89d-453d-9637-e30b64048db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Flow 'volume_create_manager' (deba2d99-8704-46f3-b59c-1c145a51ed78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:30 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7ac5b7dc-87f2-419f-b70a-27e8418e1cc9 tempest-VolumesNegativeTest-264965365 None] Created volume successfully. Jul 11 18:47:30 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 1073741824" returned: 0 in 0.995s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:30 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 Jul 11 18:47:30 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:31 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7" returned: 0 in 0.889s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:47:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a1006d-6cef-45dd-9aff-bd65cfbd5523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c474653c-d3b2-4aab-956b-574fcfe8ead7', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1559c58-afc8-4b3f-8bf8-9788558fc5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:47:31 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Volume volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 (c474653c-d3b2-4aab-956b-574fcfe8ead7): created successfully Jul 11 18:47:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1559c58-afc8-4b3f-8bf8-9788558fc5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:47:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Flow 'volume_create_manager' (fabc2c3c-eac9-4782-99ef-7e57c68461ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:47:31 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-092b5603-d349-4a34-9722-9d3c5f3ff86e tempest-VolumesSnapshotListTestJSON-1865313928 None] Created volume successfully. Jul 11 18:47:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Creating offline snapshot a9115496-7c1a-44da-aa90-9e23cd59207c of volume c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:47:33 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[908f28eb-88bb-4148-9468-0fe065456710]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:33 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 Jul 11 18:47:33 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:35 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7" returned: 0 in 1.937s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:35 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c 1G Jul 11 18:47:35 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2a94ae90-c197-4b62-b45b-b4ed8657fbba tempest-VolumesActionsTest-440279884 None] Acquiring lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674" by "attach_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2a94ae90-c197-4b62-b45b-b4ed8657fbba tempest-VolumesActionsTest-440279884 None] Lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674" acquired by "attach_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2a94ae90-c197-4b62-b45b-b4ed8657fbba tempest-VolumesActionsTest-440279884 None] Attaching volume 55cd848c-eaa4-4587-851f-5f7dff654674 to instance bfe1fb42-d172-4e87-a2fc-c9b29c842c0e at mountpoint /dev/vdb on host None. Jul 11 18:47:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2a94ae90-c197-4b62-b45b-b4ed8657fbba tempest-VolumesActionsTest-440279884 None] Attach volume completed successfully. Jul 11 18:47:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2a94ae90-c197-4b62-b45b-b4ed8657fbba tempest-VolumesActionsTest-440279884 None] Lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674" released by "attach_volume" :: held 0.167s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:36 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c 1G" returned: 0 in 1.059s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:36 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c Jul 11 18:47:36 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a58bae57-4e3f-4410-9c25-4a5ee90cd327 tempest-VolumesActionsTest-440279884 None] Acquiring lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674-detach_volume" by "detach_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:47:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a58bae57-4e3f-4410-9c25-4a5ee90cd327 tempest-VolumesActionsTest-440279884 None] Lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:47:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a58bae57-4e3f-4410-9c25-4a5ee90cd327 tempest-VolumesActionsTest-440279884 None] Detaching volume 55cd848c-eaa4-4587-851f-5f7dff654674 from instance bfe1fb42-d172-4e87-a2fc-c9b29c842c0e. Jul 11 18:47:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a58bae57-4e3f-4410-9c25-4a5ee90cd327 tempest-VolumesActionsTest-440279884 None] Detach volume completed successfully. Jul 11 18:47:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a58bae57-4e3f-4410-9c25-4a5ee90cd327 tempest-VolumesActionsTest-440279884 None] Lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674-detach_volume" released by "detach_volume" :: held 0.180s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:47:37 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c" returned: 0 in 1.110s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:37 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c is being set with open permissions: ugo+rw Jul 11 18:47:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:37 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c Jul 11 18:47:37 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:38 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c" returned: 0 in 1.545s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:38 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.info Jul 11 18:47:38 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:40 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.info" returned: 0 in 1.131s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:40 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.info is being set with open permissions: ugo+rw Jul 11 18:47:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:40 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.info Jul 11 18:47:40 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:41 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.info" returned: 0 in 1.403s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.422s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:41 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fd390c72-c28f-450f-8e5a-b96b1ad39899 tempest-VolumesSnapshotListTestJSON-1865313928 None] Create snapshot completed successfully Jul 11 18:47:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] Creating offline snapshot 60470753-d01d-446a-ae33-8bf74bae431a of volume c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:47:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[11badf80-8f13-4f1c-bd0f-5781062ec0f6]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:43 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c Jul 11 18:47:43 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:43 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c" returned: 0 in 0.805s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c474653c-d3b2-4aab-956b-574fcfe8ead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:47:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:43 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a 1G Jul 11 18:47:43 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:44 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a 1G" returned: 0 in 0.947s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:44 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a Jul 11 18:47:44 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:45 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a" returned: 0 in 1.095s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:45 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a is being set with open permissions: ugo+rw Jul 11 18:47:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:45 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a Jul 11 18:47:45 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:47 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a" returned: 0 in 1.205s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.178s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-37e8f0ec-4804-4bdc-bce2-9f34dab13a1a tempest-VolumesSnapshotListTestJSON-1865313928 None] Create snapshot completed successfully Jul 11 18:47:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa313bbf-1878-4b20-b634-93b24931ce19]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:48 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 Jul 11 18:47:48 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:49 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674" returned: 0 in 1.010s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:49 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c0ed07-8a0a-4f46-833c-c08f5af542ef]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:49 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 Jul 11 18:47:49 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:49 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674" returned: 0 in 0.795s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.1e64bbf3-2d75-4ff3-8241-64dee2a7d7292y038kbs.img {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:49 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.1e64bbf3-2d75-4ff3-8241-64dee2a7d7292y038kbs.img Jul 11 18:47:49 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:47:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:47:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:47:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:47:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:47:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:47:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:51 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:47:51 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:53 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=86,cinder:INSERT=21,cinder:UPDATE=77,cinder:DELETE=5 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:47:54 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 2.820s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:54 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:47:54 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:47:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:47:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:47:55 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.1e64bbf3-2d75-4ff3-8241-64dee2a7d7292y038kbs.img" returned: 0 in 5.860s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:55 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa1c2d9-27b6-4afd-b417-a51a4dad5dbb]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:47:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:47:55 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 Jul 11 18:47:55 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:47:56 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 11 18:47:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674" returned: 0 in 1.120s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:47:56 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.1e64bbf3-2d75-4ff3-8241-64dee2a7d7292y038kbs.img {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:47:56 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Converted 1024.00 MB image at 174.71 MB/s Jul 11 18:47:56 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] 1e64bbf3-2d75-4ff3-8241-64dee2a7d729 was raw, no need to convert to raw {{(pid=87411) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 11 18:47:59 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-b777c2d1-3e28-4c08-beec-96ccf09d2b8e req-a05fcd3b-5ae7-496a-9b48-4241ecb6e5f5 tempest-AttachVolumeTestJSON-365977217 None] Terminate volume connection completed successfully. Jul 11 18:47:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b777c2d1-3e28-4c08-beec-96ccf09d2b8e req-a05fcd3b-5ae7-496a-9b48-4241ecb6e5f5 tempest-AttachVolumeTestJSON-365977217 None] Deleting attachment 1f8c3dba-45e3-454c-828c-7e67992b15cf. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:48:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Acquiring lock "cinder-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Lock "cinder-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Acquiring lock "cinder-quobyte-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Lock "cinder-quobyte-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:06 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaf5ab5-fde0-4130-b523-1361529b71ad]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:06 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 Jul 11 18:48:06 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:07 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10" returned: 0 in 0.854s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:07 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10 Jul 11 18:48:07 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:08 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10" returned: 0 in 0.789s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Lock "cinder-quobyte-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10" released by "delete_volume" :: held 1.697s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:08 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Created reservations ['cc0cc01c-46e3-496a-8913-8bee317591e2', '41aef6c2-5f33-4b62-89bc-215e0407d018', 'fa323b1b-5a05-4d7b-b740-9bf2e21c8bad', '80f2190a-8fda-4c7a-ad8f-21723978cf9f'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:08 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:48:08 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:09 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.917s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:09 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:09 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Deleted volume successfully. Jul 11 18:48:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-416f0a6c-60d8-4221-9f8f-84803a9136de tempest-VolumesNegativeTest-264965365 None] Lock "cinder-2bd8be77-fa24-47f2-ad60-c7e1dc0bef10-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:18 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=54,cinder:INSERT=12,cinder:UPDATE=60,cinder:DELETE=5 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:48:19 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:48:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.271s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Uploaded volume to glance image-id: 1e64bbf3-2d75-4ff3-8241-64dee2a7d729. {{(pid=87411) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 11 18:48:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 31.972s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] Creating offline snapshot ae7059b1-0264-4eac-adcd-75433a535fb0 of volume c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:48:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-52bf6f45-fe47-4668-931f-35b84aeb5cac tempest-VolumesActionsTest-440279884 None] Copy volume to image completed successfully. Jul 11 18:48:20 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee60e797-90d5-4ba3-8973-7918be69fc32]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:20 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a Jul 11 18:48:20 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:21 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a" returned: 0 in 1.405s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c474653c-d3b2-4aab-956b-574fcfe8ead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:48:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:21 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 1G Jul 11 18:48:21 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:23 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 1G" returned: 0 in 1.378s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:23 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 Jul 11 18:48:23 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:24 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0" returned: 0 in 0.785s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:24 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 is being set with open permissions: ugo+rw Jul 11 18:48:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:24 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 Jul 11 18:48:24 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:24 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0" returned: 0 in 0.951s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.649s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.649s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:25 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf23591-d783-458e-ae7b-f176445af67a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:25 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-83852bca-a706-4381-a4c8-bac4dfd9d53e tempest-VolumesSnapshotListTestJSON-1865313928 None] Create snapshot completed successfully Jul 11 18:48:25 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 Jul 11 18:48:25 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:26 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674" returned: 0 in 1.048s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[758bda38-9767-4281-a240-f6566ac51257]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:26 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 Jul 11 18:48:26 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-ae7059b1-0264-4eac-adcd-75433a535fb0-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-ae7059b1-0264-4eac-adcd-75433a535fb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-quobyte-ae7059b1-0264-4eac-adcd-75433a535fb0" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-ae7059b1-0264-4eac-adcd-75433a535fb0" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Deleting offline snapshot ae7059b1-0264-4eac-adcd-75433a535fb0 of volume c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] snapshot_file for this snap is: volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[898424c7-0def-4d1b-b589-d74088e0d60e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:26 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 Jul 11 18:48:26 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:27 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674" returned: 0 in 1.057s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:27 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img Jul 11 18:48:27 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:27 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0" returned: 0 in 0.891s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c474653c-d3b2-4aab-956b-574fcfe8ead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:48:27 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff45dc1-3167-400b-b3e3-3519477546cb]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:27 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a Jul 11 18:48:27 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:29 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a" returned: 0 in 1.654s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c474653c-d3b2-4aab-956b-574fcfe8ead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:48:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:29 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 Jul 11 18:48:29 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:32 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0" returned: 0 in 3.036s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:32 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0 Jul 11 18:48:32 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img" returned: 0 in 5.895s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:33 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[927ada33-2777-4131-bd0d-58fc9a659780]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:33 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 Jul 11 18:48:33 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:33 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.ae7059b1-0264-4eac-adcd-75433a535fb0" returned: 0 in 1.462s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-ae7059b1-0264-4eac-adcd-75433a535fb0" released by "_delete_snapshot" :: held 7.230s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" released by "delete_snapshot" :: held 7.283s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:33 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Created reservations ['b9965fb5-ea83-44f4-9341-51c551344510', 'a1c5bb94-535f-4611-b1d0-09ddd3893c0b', '9b9c985d-4f0c-4f34-8b60-9435360549f8', 'd51c2799-66ab-4872-a8f1-2290b5d445b6'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:34 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Delete snapshot completed successfully. Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3622236d-b33a-4103-875c-059a8c12b58f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-ae7059b1-0264-4eac-adcd-75433a535fb0-delete_snapshot" released by "delete_snapshot" :: held 7.555s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-60470753-d01d-446a-ae33-8bf74bae431a-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-60470753-d01d-446a-ae33-8bf74bae431a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-quobyte-60470753-d01d-446a-ae33-8bf74bae431a" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-60470753-d01d-446a-ae33-8bf74bae431a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Deleting offline snapshot 60470753-d01d-446a-ae33-8bf74bae431a of volume c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] snapshot_file for this snap is: volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcaba6a-d103-45bd-bbc5-14aac10c6021]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:34 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a Jul 11 18:48:34 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:34 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674" returned: 0 in 1.395s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:48:34 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Converted 1024.00 MB image at 173.59 MB/s Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] 49c8f73d-bb76-4560-a14c-37d6d939a116 was raw, converting to qcow2 {{(pid=87411) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebd6cba-eba8-49ea-baaa-eae892652622]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:34 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img Jul 11 18:48:34 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:35 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a" returned: 0 in 0.836s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c474653c-d3b2-4aab-956b-574fcfe8ead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:48:35 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[277cb98a-3b42-46f6-9768-84a8d49e37fd]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:35 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c Jul 11 18:48:35 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:35 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img" returned: 0 in 0.783s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:35 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img Jul 11 18:48:35 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:35 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c" returned: 0 in 0.831s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c474653c-d3b2-4aab-956b-574fcfe8ead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:48:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:36 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a Jul 11 18:48:36 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:36 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img" returned: 1 in 0.801s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:48:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img /opt/stack/data/cinder/conversion/vol_upload_5v8fli86 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:36 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img /opt/stack/data/cinder/conversion/vol_upload_5v8fli86 Jul 11 18:48:36 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:36 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a" returned: 0 in 0.917s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:36 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img /opt/stack/data/cinder/conversion/vol_upload_5v8fli86" returned: 0 in 0.826s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:36 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Image conversion details: src /opt/stack/data/cinder/conversion/55cd848c-eaa4-4587-851f-5f7dff654674.temp_image.49c8f73d-bb76-4560-a14c-37d6d939a116pd4hwulj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5v8fli86 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:48:36 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 11 18:48:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e9a926-cf66-4a9d-805e-7524aad32a6c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5v8fli86 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:36 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a Jul 11 18:48:36 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:37 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5v8fli86 Jul 11 18:48:37 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:37 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.60470753-d01d-446a-ae33-8bf74bae431a" returned: 0 in 0.947s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:37 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5v8fli86" returned: 0 in 0.963s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-60470753-d01d-446a-ae33-8bf74bae431a" released by "_delete_snapshot" :: held 3.675s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" released by "delete_snapshot" :: held 3.705s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:37 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Created reservations ['2901d280-d97f-43be-a3e1-c872228a1dfe', 'ead424d5-e93c-47a9-a02e-d427448757dc', '977bf94f-2604-41b2-8c98-6b9d15501098', 'cd67386c-2b66-4b65-a26e-b2d9e862e757'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Delete snapshot completed successfully. Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d78c708a-d578-4930-9659-0527d9e3074a tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-60470753-d01d-446a-ae33-8bf74bae431a-delete_snapshot" released by "delete_snapshot" :: held 3.886s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-a9115496-7c1a-44da-aa90-9e23cd59207c-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-a9115496-7c1a-44da-aa90-9e23cd59207c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-quobyte-a9115496-7c1a-44da-aa90-9e23cd59207c" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-a9115496-7c1a-44da-aa90-9e23cd59207c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Deleting offline snapshot a9115496-7c1a-44da-aa90-9e23cd59207c of volume c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] snapshot_file for this snap is: volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[3050acf6-60e0-41ac-a24b-a11ab40a3d21]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:38 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c Jul 11 18:48:38 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.885s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Uploaded volume to glance image-id: 49c8f73d-bb76-4560-a14c-37d6d939a116. {{(pid=87411) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 11 18:48:39 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c" returned: 0 in 1.349s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c474653c-d3b2-4aab-956b-574fcfe8ead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:48:39 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5b2872fd-2e88-4f94-985d-22753d70c5fc tempest-VolumesActionsTest-440279884 None] Copy volume to image completed successfully. Jul 11 18:48:39 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8f2ee7-e8b3-4abb-b1cd-c05523616612]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:40 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 Jul 11 18:48:40 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:40 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7" returned: 0 in 1.004s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:41 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c Jul 11 18:48:41 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Acquiring lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Acquiring lock "cinder-quobyte-55cd848c-eaa4-4587-851f-5f7dff654674" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Lock "cinder-quobyte-55cd848c-eaa4-4587-851f-5f7dff654674" acquired by "delete_volume" :: waited 0.033s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:41 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[184cdbc6-ef98-4a8c-8e4c-25e87206f843]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:41 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 Jul 11 18:48:41 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:42 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c" returned: 0 in 1.097s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:42 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c Jul 11 18:48:42 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:42 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674" returned: 0 in 0.868s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:42 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674 Jul 11 18:48:42 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Flow 'volume_create_manager' (ec5a6e20-3803-48d4-a301-24a794d09ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d30aacd-f70b-4573-8799-6d55d6e04b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d30aacd-f70b-4573-8799-6d55d6e04b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-154398641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78208805-1785-4f10-926f-7f960535a3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60f43be3cc14d81acef61e295196a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:43Z,use_quota=True,user_id='e311a38a21644d159d81b247d92c4ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f61c58-a140-4b3f-9dbd-d91fb0d81157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f61c58-a140-4b3f-9dbd-d91fb0d81157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350b7303-1c0e-4385-a7dc-d4fd1c91bd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350b7303-1c0e-4385-a7dc-d4fd1c91bd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78208805-1785-4f10-926f-7f960535a3a9', 'volume_name': 'volume-78208805-1785-4f10-926f-7f960535a3a9', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2954d08e-62a3-47e5-8373-cd682a6b67a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2954d08e-62a3-47e5-8373-cd682a6b67a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202a195e-c688-4a3c-8e2c-362db721e984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:42 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Volume 78208805-1785-4f10-926f-7f960535a3a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78208805-1785-4f10-926f-7f960535a3a9', 'volume_size': 1} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-154398641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78208805-1785-4f10-926f-7f960535a3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60f43be3cc14d81acef61e295196a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:43Z,use_quota=True,user_id='e311a38a21644d159d81b247d92c4ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Creating volume 78208805-1785-4f10-926f-7f960535a3a9 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:42 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:42 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 1073741824 Jul 11 18:48:42 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:42 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7.a9115496-7c1a-44da-aa90-9e23cd59207c" returned: 0 in 0.818s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-a9115496-7c1a-44da-aa90-9e23cd59207c" released by "_delete_snapshot" :: held 4.472s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" released by "delete_snapshot" :: held 4.507s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Created reservations ['0578ab9a-7df4-4a80-9538-49b41eadadf8', '5bb29c61-00af-44bf-8044-b1af92491adf', '59f062d5-c686-42f3-8553-be9134ae013c', '2b1de384-d511-4fd3-b690-a6879cae902b'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Flow 'volume_create_manager' (5f9a9276-f8a2-4a9c-90c7-ac1272714d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace8e47c-b0ef-4354-ac82-067a1d0d5d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace8e47c-b0ef-4354-ac82-067a1d0d5d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1988798750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d38ea90-cd2b-4efb-bdd4-5af4f7af5203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60f43be3cc14d81acef61e295196a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:43Z,use_quota=True,user_id='e311a38a21644d159d81b247d92c4ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87faffa8-dd92-44ec-8afb-d4a17ff8b1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87faffa8-dd92-44ec-8afb-d4a17ff8b1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cef89cc-3bf5-436a-a194-89220b6e0578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cef89cc-3bf5-436a-a194-89220b6e0578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d38ea90-cd2b-4efb-bdd4-5af4f7af5203', 'volume_name': 'volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60d0fe6-a8b3-4b05-84f1-c946d707faa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60d0fe6-a8b3-4b05-84f1-c946d707faa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f704131-0340-4afc-a437-b27ceb3bd5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:43 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Volume 0d38ea90-cd2b-4efb-bdd4-5af4f7af5203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203', 'volume_size': 1} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:43 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Delete snapshot completed successfully. Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9083513e-d1e3-465f-b3d8-7a01f486701f tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-a9115496-7c1a-44da-aa90-9e23cd59207c-delete_snapshot" released by "delete_snapshot" :: held 4.923s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:43 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-55cd848c-eaa4-4587-851f-5f7dff654674" returned: 0 in 1.007s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Lock "cinder-quobyte-55cd848c-eaa4-4587-851f-5f7dff654674" released by "delete_volume" :: held 1.940s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Created reservations ['6a676afc-c39b-4368-9b13-910ec4224d5f', '319464c8-6188-4f19-81f6-fa43e6b236d4', '075d594e-3fb8-430f-98ac-eb7de90fc38e', 'c11f6598-308f-4c4c-a694-9b9aff1c586d'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:43 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:48:43 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:44 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 1073741824" returned: 0 in 1.248s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-c474653c-d3b2-4aab-956b-574fcfe8ead7-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-c474653c-d3b2-4aab-956b-574fcfe8ead7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:44 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 Jul 11 18:48:44 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b82753-d06d-4e3d-a039-e5c83d7344f7]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:44 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 Jul 11 18:48:44 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:44 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.960s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Deleted volume successfully. Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3127c87a-0fb1-4cde-acca-30c0ac7c51b6 tempest-VolumesActionsTest-440279884 None] Lock "cinder-55cd848c-eaa4-4587-851f-5f7dff654674-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:44 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9" returned: 0 in 0.882s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] <== create_volume: return (2211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.215s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1988798750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d38ea90-cd2b-4efb-bdd4-5af4f7af5203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60f43be3cc14d81acef61e295196a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:43Z,use_quota=True,user_id='e311a38a21644d159d81b247d92c4ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Creating volume 0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:44 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:48:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202a195e-c688-4a3c-8e2c-362db721e984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78208805-1785-4f10-926f-7f960535a3a9', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:45 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 1073741824 Jul 11 18:48:45 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e410547-14aa-4042-a961-baf2d7c9a496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:45 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Volume volume-78208805-1785-4f10-926f-7f960535a3a9 (78208805-1785-4f10-926f-7f960535a3a9): created successfully Jul 11 18:48:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e410547-14aa-4042-a961-baf2d7c9a496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Flow 'volume_create_manager' (ec5a6e20-3803-48d4-a301-24a794d09ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:45 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-72c24899-8473-4ec4-832a-ad46532db9f1 tempest-TestServerVolumeAttachmentScenario-508390035 None] Created volume successfully. Jul 11 18:48:45 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7" returned: 0 in 1.141s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:45 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7 Jul 11 18:48:45 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:46 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 1073741824" returned: 0 in 1.153s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:46 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c474653c-d3b2-4aab-956b-574fcfe8ead7" returned: 0 in 0.806s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:46 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 Jul 11 18:48:46 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-quobyte-c474653c-d3b2-4aab-956b-574fcfe8ead7" released by "delete_volume" :: held 2.035s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Created reservations ['ceef863a-d981-4495-a3a5-3ea21818dca6', '0d9e601b-42ec-4096-942e-6d64123cc8b5', '84db8b82-715f-472b-9937-39345f04590a', '5e93de39-764a-4525-b0d7-a525af7ade33'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:46 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:48:46 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:47 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203" returned: 0 in 0.902s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f704131-0340-4afc-a437-b27ceb3bd5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6a8a63-1c9f-4746-a9d8-dc1d27f0c1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:47 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Volume volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 (0d38ea90-cd2b-4efb-bdd4-5af4f7af5203): created successfully Jul 11 18:48:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6a8a63-1c9f-4746-a9d8-dc1d27f0c1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Flow 'volume_create_manager' (5f9a9276-f8a2-4a9c-90c7-ac1272714d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b34434b3-9d0a-4fcc-ae96-afdb5532d839 tempest-TestServerVolumeAttachmentScenario-508390035 None] Created volume successfully. Jul 11 18:48:47 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.748s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:47 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Deleted volume successfully. Jul 11 18:48:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-259eee70-b51a-4375-b1e5-705c2d065a96 tempest-VolumesSnapshotListTestJSON-1865313928 None] Lock "cinder-c474653c-d3b2-4aab-956b-574fcfe8ead7-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:51 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:48:51 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Flow 'volume_create_manager' (a10705bb-9045-4244-9c5b-d11d2e499856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cbe914-2509-40bc-861d-a9ad3b3738bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cbe914-2509-40bc-861d-a9ad3b3738bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-572128262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a278d5-16ad-4f27-ad94-a09b17031a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4c5c5d40f14e5fb16a32599f43d00a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:52Z,use_quota=True,user_id='9c3707e970ed457c9e1a21e928a02656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee7f714-c55f-4451-bb48-58832d63886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee7f714-c55f-4451-bb48-58832d63886c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82278290-d984-4ed3-94a5-da367e299fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82278290-d984-4ed3-94a5-da367e299fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a278d5-16ad-4f27-ad94-a09b17031a6c', 'volume_name': 'volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c', 'volume_size': 2}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72466e42-57e5-4629-91fe-407299abea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72466e42-57e5-4629-91fe-407299abea10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f4d247-62f5-434a-a1c9-730f5a394807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:52 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Volume a9a278d5-16ad-4f27-ad94-a09b17031a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c', 'volume_size': 2} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-572128262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a278d5-16ad-4f27-ad94-a09b17031a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4c5c5d40f14e5fb16a32599f43d00a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:52Z,use_quota=True,user_id='9c3707e970ed457c9e1a21e928a02656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Creating volume a9a278d5-16ad-4f27-ad94-a09b17031a6c {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:52 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c 2147483648 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:52 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c 2147483648 Jul 11 18:48:52 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Flow 'volume_create_manager' (01461c2e-921e-4938-be72-1a4505cc94f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb3ecf1-423f-4bb9-b921-d1c83f9a5fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb3ecf1-423f-4bb9-b921-d1c83f9a5fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1395492401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a69a585-0fbc-49cd-8ab7-1e461416274e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b98ba8a4644ca89326a50a690d75bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:52Z,use_quota=True,user_id='59d49915f4674b2d8219742bd87ad860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a350ee95-6914-4526-9e0c-b4cf0f052ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a350ee95-6914-4526-9e0c-b4cf0f052ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81a88ba-2192-4cb2-9267-1feb1a86ae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81a88ba-2192-4cb2-9267-1feb1a86ae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a69a585-0fbc-49cd-8ab7-1e461416274e', 'volume_name': 'volume-9a69a585-0fbc-49cd-8ab7-1e461416274e', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1ec6f5-f801-4a0a-a911-64d640e436a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1ec6f5-f801-4a0a-a911-64d640e436a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10384a93-d9d1-41d8-86a1-c4112d88b84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:52 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Volume 9a69a585-0fbc-49cd-8ab7-1e461416274e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a69a585-0fbc-49cd-8ab7-1e461416274e', 'volume_size': 1} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:52 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.986s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:48:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:48:53 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c 2147483648" returned: 0 in 0.976s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:53 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c Jul 11 18:48:53 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:53 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c" returned: 0 in 0.669s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1395492401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a69a585-0fbc-49cd-8ab7-1e461416274e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b98ba8a4644ca89326a50a690d75bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:52Z,use_quota=True,user_id='59d49915f4674b2d8219742bd87ad860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Creating volume 9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:48:53 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:53 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e 1073741824 Jul 11 18:48:53 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f4d247-62f5-434a-a1c9-730f5a394807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c', 'volume_size': 2}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebdd040e-8c83-4ec4-99b2-5ac955c45ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:53 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Volume volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c (a9a278d5-16ad-4f27-ad94-a09b17031a6c): created successfully Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebdd040e-8c83-4ec4-99b2-5ac955c45ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Flow 'volume_create_manager' (a10705bb-9045-4244-9c5b-d11d2e499856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:53 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-eae6b35c-e60e-41cb-90d6-da50d7d23cde tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Created volume successfully. Jul 11 18:48:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:54 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e 1073741824" returned: 0 in 0.930s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:54 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e Jul 11 18:48:54 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:55 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e" returned: 0 in 0.736s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.239s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10384a93-d9d1-41d8-86a1-c4112d88b84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a69a585-0fbc-49cd-8ab7-1e461416274e', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac371ed-4c2a-418b-857d-6766878f0e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Creating offline snapshot 5d62c47f-5a1f-43bb-aa24-c39937363b47 of volume a9a278d5-16ad-4f27-ad94-a09b17031a6c {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:48:55 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Volume volume-9a69a585-0fbc-49cd-8ab7-1e461416274e (9a69a585-0fbc-49cd-8ab7-1e461416274e): created successfully Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac371ed-4c2a-418b-857d-6766878f0e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Flow 'volume_create_manager' (01461c2e-921e-4938-be72-1a4505cc94f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f6340-6867-4c16-9ef9-c700c2774bac]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:48:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-abb79e22-711c-4a99-a5f9-c82610fa3021 tempest-VolumesCloneTest-1184035518 None] Created volume successfully. Jul 11 18:48:55 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c Jul 11 18:48:55 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:56 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c" returned: 0 in 0.860s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 2G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:56 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 2G Jul 11 18:48:56 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Flow 'volume_create_manager' (f36019e9-132c-4c10-9e01-5482b4fca0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151eb221-3072-4f69-8362-840524ef3366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151eb221-3072-4f69-8362-840524ef3366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-688621271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6fe582-90a6-4aba-9286-7c658d63add5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b98ba8a4644ca89326a50a690d75bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:48:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9a69a585-0fbc-49cd-8ab7-1e461416274e,status='creating',terminated_at=None,updated_at=2026-07-11T16:48:57Z,use_quota=True,user_id='59d49915f4674b2d8219742bd87ad860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab48ad1-76e2-4a58-abb1-5ab05bc49e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab48ad1-76e2-4a58-abb1-5ab05bc49e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b8fe97-21bc-4f79-b42c-a0e9328d0378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b8fe97-21bc-4f79-b42c-a0e9328d0378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7b6fe582-90a6-4aba-9286-7c658d63add5', 'volume_name': 'volume-7b6fe582-90a6-4aba-9286-7c658d63add5', 'volume_size': 2, 'source_volid': '9a69a585-0fbc-49cd-8ab7-1e461416274e', 'source_volstatus': 'available'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa08767-8b7e-42e4-8129-f758a187f762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa08767-8b7e-42e4-8129-f758a187f762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5759e9-94b1-4fc1-b71e-b3975d46168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:48:57 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Volume 7b6fe582-90a6-4aba-9286-7c658d63add5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7b6fe582-90a6-4aba-9286-7c658d63add5', 'volume_size': 2, 'source_volid': '9a69a585-0fbc-49cd-8ab7-1e461416274e', 'source_volstatus': 'available'} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:48:57 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 2G" returned: 0 in 1.144s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:57 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 Jul 11 18:48:57 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:58 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47" returned: 0 in 0.710s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:58 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 is being set with open permissions: ugo+rw Jul 11 18:48:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:58 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 Jul 11 18:48:58 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:58 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47" returned: 0 in 0.675s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:58 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.info Jul 11 18:48:58 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:48:59 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 11 18:48:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.info" returned: 0 in 0.724s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:48:59 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.info is being set with open permissions: ugo+rw Jul 11 18:48:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:48:59 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.info Jul 11 18:48:59 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:00 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.info" returned: 0 in 0.892s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.133s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.219s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:00 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Cloning volume 9a69a585-0fbc-49cd-8ab7-1e461416274e to volume 7b6fe582-90a6-4aba-9286-7c658d63add5 Jul 11 18:49:00 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-925c4fc0-8fb0-4aeb-af0f-7d91dd6bd856 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Create snapshot completed successfully Jul 11 18:49:00 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Creating offline snapshot 165376cb-b677-47fe-ab3b-fe1d672ccf08 of volume 9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:49:00 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2edcbfe-8534-49fb-97bd-38f8ae2e0312]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:00 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e Jul 11 18:49:00 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:01 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e" returned: 0 in 0.959s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:01 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 1G Jul 11 18:49:01 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Acquiring lock "cinder-5d62c47f-5a1f-43bb-aa24-c39937363b47-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "cinder-5d62c47f-5a1f-43bb-aa24-c39937363b47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Acquiring lock "cinder-quobyte-a9a278d5-16ad-4f27-ad94-a09b17031a6c" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "cinder-quobyte-a9a278d5-16ad-4f27-ad94-a09b17031a6c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Acquiring lock "cinder-quobyte-5d62c47f-5a1f-43bb-aa24-c39937363b47" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "cinder-quobyte-5d62c47f-5a1f-43bb-aa24-c39937363b47" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Deleting offline snapshot 5d62c47f-5a1f-43bb-aa24-c39937363b47 of volume a9a278d5-16ad-4f27-ad94-a09b17031a6c {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] snapshot_file for this snap is: volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f56ca23-1585-4147-961c-1213b5fc7350]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:02 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 Jul 11 18:49:02 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:02 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 1G" returned: 0 in 1.217s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a69a585-0fbc-49cd-8ab7-1e461416274e -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:02 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a69a585-0fbc-49cd-8ab7-1e461416274e -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 Jul 11 18:49:02 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:02 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47" returned: 0 in 1.029s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:49:02 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32be59a-9422-4580-88cf-f841ba5f07b8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:03 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c Jul 11 18:49:03 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:03 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a69a585-0fbc-49cd-8ab7-1e461416274e -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08" returned: 0 in 0.800s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:03 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 is being set with open permissions: ugo+rw Jul 11 18:49:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:03 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 Jul 11 18:49:03 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:04 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c" returned: 0 in 1.077s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:04 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 Jul 11 18:49:04 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:04 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08" returned: 0 in 0.950s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:04 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.info Jul 11 18:49:04 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:05 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47" returned: 0 in 1.048s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:05 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47 Jul 11 18:49:05 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:05 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.info" returned: 0 in 1.201s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:05 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.info is being set with open permissions: ugo+rw Jul 11 18:49:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:05 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.info Jul 11 18:49:05 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:06 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c.5d62c47f-5a1f-43bb-aa24-c39937363b47" returned: 0 in 1.029s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "cinder-quobyte-5d62c47f-5a1f-43bb-aa24-c39937363b47" released by "_delete_snapshot" :: held 4.346s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "cinder-quobyte-a9a278d5-16ad-4f27-ad94-a09b17031a6c" released by "delete_snapshot" :: held 4.400s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:06 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Created reservations ['00bb0e72-f518-48d5-a290-f95287d10186', '3796b9b5-df36-4ead-a33f-d32362611290', '14de4fa7-24b9-4d16-ac21-cc1d2673c369', 'e18b69e4-dfa1-418d-9e4f-41dc3aaccd04'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:06 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Delete snapshot completed successfully. Jul 11 18:49:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5052dd47-70e8-4952-bef2-1a14639d9056 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "cinder-5d62c47f-5a1f-43bb-aa24-c39937363b47-delete_snapshot" released by "delete_snapshot" :: held 4.645s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:07 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.info" returned: 0 in 1.467s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "cinder-quobyte-7b6fe582-90a6-4aba-9286-7c658d63add5" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-quobyte-7b6fe582-90a6-4aba-9286-7c658d63add5" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] snapshot: 165376cb-b677-47fe-ab3b-fe1d672ccf08, volume: 7b6fe582-90a6-4aba-9286-7c658d63add5, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Acquiring lock "cinder-a9a278d5-16ad-4f27-ad94-a09b17031a6c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdadbe0-e21b-4397-89cb-6acfc60cf0f0]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "cinder-a9a278d5-16ad-4f27-ad94-a09b17031a6c-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Acquiring lock "cinder-quobyte-a9a278d5-16ad-4f27-ad94-a09b17031a6c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "cinder-quobyte-a9a278d5-16ad-4f27-ad94-a09b17031a6c" acquired by "delete_volume" :: waited 0.038s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:07 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 Jul 11 18:49:07 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ad3975-d798-4df1-be99-5a1e86f6ea2f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:08 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c Jul 11 18:49:08 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:08 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08" returned: 0 in 1.406s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a69a585-0fbc-49cd-8ab7-1e461416274e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:49:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:49:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:49:08 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d08813f-f215-4dfd-9530-98b4ac45d9f6]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:09 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e Jul 11 18:49:09 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:09 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c" returned: 0 in 1.670s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:09 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c Jul 11 18:49:09 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:10 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e" returned: 0 in 1.637s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:10 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:49:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:10 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 Jul 11 18:49:10 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:10 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a278d5-16ad-4f27-ad94-a09b17031a6c" returned: 0 in 1.289s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "cinder-quobyte-a9a278d5-16ad-4f27-ad94-a09b17031a6c" released by "delete_volume" :: held 3.083s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:10 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Created reservations ['9c3eeffe-67af-4b3e-8a5a-9326117783a2', 'db7e9c60-40f7-4810-9682-decb7bab7b1d', 'd8702735-317b-434a-a54d-82a31ad607ef', '1bce5e3d-bd3f-4293-bf59-94b7af244796'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:11 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:49:11 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:12 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.904s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:12 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:12 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Deleted volume successfully. Jul 11 18:49:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2ac34b7-d2ff-4ca0-943b-340655d80ae7 tempest-VolumesSnapshotNegativeTestJSON-966751390 None] Lock "cinder-a9a278d5-16ad-4f27-ad94-a09b17031a6c-delete_volume" released by "delete_volume" :: held 5.415s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:19 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5" returned: 0 in 8.790s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:19 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ee7fdd-0dd4-4035-9a94-dcddac8b6ced]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:19 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e Jul 11 18:49:19 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:20 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e" returned: 0 in 1.092s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:20 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e, size 1024.00 MB, duration 8.79 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:49:20 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Converted 1024.00 MB image at 116.47 MB/s Jul 11 18:49:20 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 is being set with open permissions: ugo+rw Jul 11 18:49:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:20 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 Jul 11 18:49:20 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:20 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=56,cinder:UPDATE=65,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:49:21 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5" returned: 0 in 0.695s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-quobyte-7b6fe582-90a6-4aba-9286-7c658d63add5" released by "_copy_volume_from_snapshot" :: held 13.805s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "cinder-quobyte-165376cb-b677-47fe-ab3b-fe1d672ccf08" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-quobyte-165376cb-b677-47fe-ab3b-fe1d672ccf08" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Deleting offline snapshot 165376cb-b677-47fe-ab3b-fe1d672ccf08 of volume 9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:49:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] snapshot_file for this snap is: volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:49:21 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b705c86a-22f0-4e7b-9536-c9f2f49d994d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:21 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 Jul 11 18:49:21 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:22 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08" returned: 0 in 0.876s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a69a585-0fbc-49cd-8ab7-1e461416274e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:49:22 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6293774b-e586-48d2-8c65-db3bc8c20682]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:22 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e Jul 11 18:49:22 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:22 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=54,cinder:UPDATE=59,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:49:23 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e" returned: 0 in 0.831s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:23 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 Jul 11 18:49:23 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:23 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08" returned: 0 in 0.897s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:23 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08 Jul 11 18:49:23 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:24 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e.165376cb-b677-47fe-ab3b-fe1d672ccf08" returned: 0 in 0.705s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-quobyte-165376cb-b677-47fe-ab3b-fe1d672ccf08" released by "_delete_snapshot" :: held 3.429s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.130s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5759e9-94b1-4fc1-b71e-b3975d46168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6fe582-90a6-4aba-9286-7c658d63add5', 'volume_size': 2, 'source_volid': '9a69a585-0fbc-49cd-8ab7-1e461416274e', 'source_volstatus': 'available'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da053c1a-6f0e-491a-95b1-a478044d3826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:24 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Volume volume-7b6fe582-90a6-4aba-9286-7c658d63add5 (7b6fe582-90a6-4aba-9286-7c658d63add5): created successfully Jul 11 18:49:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da053c1a-6f0e-491a-95b1-a478044d3826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Flow 'volume_create_manager' (f36019e9-132c-4c10-9e01-5482b4fca0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-aebbb6ea-52c7-43e9-9c2e-2ec2d7b41a07 tempest-VolumesCloneTest-1184035518 None] Created volume successfully. Jul 11 18:49:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "cinder-7b6fe582-90a6-4aba-9286-7c658d63add5-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-7b6fe582-90a6-4aba-9286-7c658d63add5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "cinder-quobyte-7b6fe582-90a6-4aba-9286-7c658d63add5" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-quobyte-7b6fe582-90a6-4aba-9286-7c658d63add5" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:26 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6c33d4-b868-4d66-91cd-a359f24f74bf]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:26 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 Jul 11 18:49:26 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:26 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5" returned: 0 in 0.783s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:26 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5 Jul 11 18:49:26 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:27 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7b6fe582-90a6-4aba-9286-7c658d63add5" returned: 0 in 0.681s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-quobyte-7b6fe582-90a6-4aba-9286-7c658d63add5" released by "delete_volume" :: held 1.506s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:27 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Created reservations ['62170a4b-fb5b-4e18-bba5-d1a4219a1793', 'f6869617-526b-46a2-9131-7a4352826137', 'e0ec9a5c-75be-4fe0-88eb-552bd7deb339', 'b6ad35ea-da4c-473a-b4ae-3e3cbfef8810'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:27 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:49:27 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "cinder-9a69a585-0fbc-49cd-8ab7-1e461416274e-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-9a69a585-0fbc-49cd-8ab7-1e461416274e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:28 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.721s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:28 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "cinder-quobyte-9a69a585-0fbc-49cd-8ab7-1e461416274e" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:28 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Deleted volume successfully. Jul 11 18:49:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-quobyte-9a69a585-0fbc-49cd-8ab7-1e461416274e" acquired by "delete_volume" :: waited 0.029s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0bd7c435-d825-45d0-b985-19c20c94f855 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-7b6fe582-90a6-4aba-9286-7c658d63add5-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:28 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c334ea9-87f0-4f4b-8a4b-9fd56a22d935]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:28 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e Jul 11 18:49:28 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:29 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e" returned: 0 in 0.873s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:29 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e Jul 11 18:49:29 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:30 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a69a585-0fbc-49cd-8ab7-1e461416274e" returned: 0 in 0.784s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-quobyte-9a69a585-0fbc-49cd-8ab7-1e461416274e" released by "delete_volume" :: held 1.758s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:30 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Created reservations ['ecc0cfd9-cf96-4b13-b3d7-96b8a5a9051c', 'bb3ca5b1-8a3b-4da8-a37f-8a97e2c4e678', 'f942ea48-d689-43d4-8182-4cd02884c5ed', 'c5aee7d0-24dd-43bd-a6d4-011fb44a3919'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:30 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:49:30 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:31 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.887s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:31 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:31 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Deleted volume successfully. Jul 11 18:49:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6d97bab3-d601-4450-b83e-481c1cda67a2 tempest-VolumesCloneTest-1184035518 None] Lock "cinder-9a69a585-0fbc-49cd-8ab7-1e461416274e-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-33dfbb59-b298-4d88-9cf0-5cb88adbdf8d req-7cb0f91b-74cf-4d89-b8f4-acb99a54bb02 tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-33dfbb59-b298-4d88-9cf0-5cb88adbdf8d req-7cb0f91b-74cf-4d89-b8f4-acb99a54bb02 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:32 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5eaa64-0da7-4910-b985-0b73b295bb7f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-33dfbb59-b298-4d88-9cf0-5cb88adbdf8d req-7cb0f91b-74cf-4d89-b8f4-acb99a54bb02 tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:32 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 Jul 11 18:49:32 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:33 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-33dfbb59-b298-4d88-9cf0-5cb88adbdf8d req-7cb0f91b-74cf-4d89-b8f4-acb99a54bb02 tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9" returned: 0 in 1.152s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-33dfbb59-b298-4d88-9cf0-5cb88adbdf8d req-7cb0f91b-74cf-4d89-b8f4-acb99a54bb02 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.180s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-33dfbb59-b298-4d88-9cf0-5cb88adbdf8d req-7cb0f91b-74cf-4d89-b8f4-acb99a54bb02 tempest-TestServerVolumeAttachmentScenario-508390035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-78208805-1785-4f10-926f-7f960535a3a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7012e233-da70-4010-a1d5-8ae7a636d7b5', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Flow 'volume_create_manager' (b371cd35-2dee-4647-8879-6146b235994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307c17ad-4227-453a-9e66-445541b24b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307c17ad-4227-453a-9e66-445541b24b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1746671139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6ce3ec-3e7c-4f11-9747-668cf6b2946d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bbc3fcd5a4b2da73005b44c40cf9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:33Z,use_quota=True,user_id='05e5847e57504277b3c454319772c073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4bef8ec-9287-4b08-a803-e4ff77eb0b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4bef8ec-9287-4b08-a803-e4ff77eb0b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5deea0c-6287-4eec-8b0d-95b13561a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5deea0c-6287-4eec-8b0d-95b13561a68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6ce3ec-3e7c-4f11-9747-668cf6b2946d', 'volume_name': 'volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8cef52-989b-4447-bc44-09eb3e3cb722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8cef52-989b-4447-bc44-09eb3e3cb722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2442b0f7-c9da-4436-a1d6-3f69287067dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:33 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Volume 7c6ce3ec-3e7c-4f11-9747-668cf6b2946d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d', 'volume_size': 1} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1746671139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6ce3ec-3e7c-4f11-9747-668cf6b2946d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bbc3fcd5a4b2da73005b44c40cf9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:33Z,use_quota=True,user_id='05e5847e57504277b3c454319772c073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Creating volume 7c6ce3ec-3e7c-4f11-9747-668cf6b2946d {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:33 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:49:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:33 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-33dfbb59-b298-4d88-9cf0-5cb88adbdf8d req-7cb0f91b-74cf-4d89-b8f4-acb99a54bb02 tempest-TestServerVolumeAttachmentScenario-508390035 None] attachment_update completed successfully. Jul 11 18:49:33 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d 1073741824 Jul 11 18:49:33 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Flow 'volume_create_manager' (1c8df4a4-6ba3-417d-acf0-543a6ab551bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbbfa3d-2fe6-4a26-bd5d-139a4a82bab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbbfa3d-2fe6-4a26-bd5d-139a4a82bab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1070683836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f683e9b-4662-4727-be45-79b4dac86e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f35839aaa841caad3a4822893b1088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:34Z,use_quota=True,user_id='d840e24369194883923f53b0cfaceecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8092800e-ab6d-4938-b406-0be7788b8fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8092800e-ab6d-4938-b406-0be7788b8fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e3a296-b945-49f3-8582-fd92371a15f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e3a296-b945-49f3-8582-fd92371a15f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f683e9b-4662-4727-be45-79b4dac86e88', 'volume_name': 'volume-8f683e9b-4662-4727-be45-79b4dac86e88', 'volume_size': 2}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebcc13f-18ab-40b1-ba32-82ee6af672a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebcc13f-18ab-40b1-ba32-82ee6af672a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:34 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658e677d-7f74-4cb7-8e4d-182471b9cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:34 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Volume 8f683e9b-4662-4727-be45-79b4dac86e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f683e9b-4662-4727-be45-79b4dac86e88', 'volume_size': 2} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d 1073741824" returned: 0 in 1.045s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:34 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d Jul 11 18:49:34 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:35 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d" returned: 0 in 0.680s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1070683836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f683e9b-4662-4727-be45-79b4dac86e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f35839aaa841caad3a4822893b1088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:34Z,use_quota=True,user_id='d840e24369194883923f53b0cfaceecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Creating volume 8f683e9b-4662-4727-be45-79b4dac86e88 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:35 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88 2147483648 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:35 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88 2147483648 Jul 11 18:49:35 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2442b0f7-c9da-4436-a1d6-3f69287067dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe3faee-adfb-4cf2-bdb6-a18e5715f6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:35 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Volume volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d (7c6ce3ec-3e7c-4f11-9747-668cf6b2946d): created successfully Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe3faee-adfb-4cf2-bdb6-a18e5715f6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Flow 'volume_create_manager' (b371cd35-2dee-4647-8879-6146b235994a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-091c48ea-00e6-4fc7-8323-8d62997e307a tempest-AttachVolumeTestJSON-365977217 None] Created volume successfully. Jul 11 18:49:36 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88 2147483648" returned: 0 in 0.998s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:36 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88 Jul 11 18:49:36 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:37 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88" returned: 0 in 0.761s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658e677d-7f74-4cb7-8e4d-182471b9cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f683e9b-4662-4727-be45-79b4dac86e88', 'volume_size': 2}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f472dc6-50c7-4479-a5ca-30f835f3ff71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:37 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Volume volume-8f683e9b-4662-4727-be45-79b4dac86e88 (8f683e9b-4662-4727-be45-79b4dac86e88): created successfully Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f472dc6-50c7-4479-a5ca-30f835f3ff71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Flow 'volume_create_manager' (1c8df4a4-6ba3-417d-acf0-543a6ab551bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:37 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a82395f2-7c49-4c41-b1e3-266f04558ea1 tempest-VolumesCloneNegativeTest-1524284233 None] Created volume successfully. Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Acquiring lock "cinder-8f683e9b-4662-4727-be45-79b4dac86e88-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Lock "cinder-8f683e9b-4662-4727-be45-79b4dac86e88-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Acquiring lock "cinder-quobyte-8f683e9b-4662-4727-be45-79b4dac86e88" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Lock "cinder-quobyte-8f683e9b-4662-4727-be45-79b4dac86e88" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45a33e1-273c-4151-b32f-0ced3806a721]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:38 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88 Jul 11 18:49:38 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:38 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88" returned: 0 in 0.887s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:38 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88 Jul 11 18:49:38 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-4c7d8bcc-3d0f-409b-a83b-3dc543e06e0e req-c715b57d-cd28-462b-b26a-933e9e00a6e0 tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-4c7d8bcc-3d0f-409b-a83b-3dc543e06e0e req-c715b57d-cd28-462b-b26a-933e9e00a6e0 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9864edf5-6ac2-4deb-91a5-5ad6cb9f42c5]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-4c7d8bcc-3d0f-409b-a83b-3dc543e06e0e req-c715b57d-cd28-462b-b26a-933e9e00a6e0 tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:39 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d Jul 11 18:49:39 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:39 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f683e9b-4662-4727-be45-79b4dac86e88" returned: 0 in 0.778s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Lock "cinder-quobyte-8f683e9b-4662-4727-be45-79b4dac86e88" released by "delete_volume" :: held 1.733s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Created reservations ['1cba3390-8c62-48fd-ac39-9b3bb7ed5bac', '943acfbf-a494-41f0-8d77-5486fff9092b', '439b1d76-6c37-4bc8-9a57-39ddce671cd9', '0d1b4119-9aaa-48a5-989e-c93a961b0b99'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:39 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:49:39 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:40 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-4c7d8bcc-3d0f-409b-a83b-3dc543e06e0e req-c715b57d-cd28-462b-b26a-933e9e00a6e0 tempest-AttachVolumeTestJSON-365977217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d" returned: 0 in 1.185s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-4c7d8bcc-3d0f-409b-a83b-3dc543e06e0e req-c715b57d-cd28-462b-b26a-933e9e00a6e0 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.218s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-4c7d8bcc-3d0f-409b-a83b-3dc543e06e0e req-c715b57d-cd28-462b-b26a-933e9e00a6e0 tempest-AttachVolumeTestJSON-365977217 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a4b87f4-09f7-4032-b0c9-fb03a94a5263', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:49:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-4c7d8bcc-3d0f-409b-a83b-3dc543e06e0e req-c715b57d-cd28-462b-b26a-933e9e00a6e0 tempest-AttachVolumeTestJSON-365977217 None] attachment_update completed successfully. Jul 11 18:49:41 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.083s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:41 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:41 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Deleted volume successfully. Jul 11 18:49:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7356113-2c36-4d81-ae50-c27fa44fb647 tempest-VolumesCloneNegativeTest-1524284233 None] Lock "cinder-8f683e9b-4662-4727-be45-79b4dac86e88-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (7f3b3a98-60e2-4edc-9685-b0ccc06f8827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bac585b-474e-4e33-963d-d83a1c5fed8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bac585b-474e-4e33-963d-d83a1c5fed8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2064818592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081bd5f5-3b98-42ed-b94b-79421a224435,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:44Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907f687d-9e5c-4a16-bd6d-da864e1ff3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907f687d-9e5c-4a16-bd6d-da864e1ff3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d4bcd5-abdc-425e-b9cf-177e08bd75dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d4bcd5-abdc-425e-b9cf-177e08bd75dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081bd5f5-3b98-42ed-b94b-79421a224435', 'volume_name': 'volume-081bd5f5-3b98-42ed-b94b-79421a224435', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba55de7-3bcd-4d45-95a9-80cd4ce99daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba55de7-3bcd-4d45-95a9-80cd4ce99daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b83199-2243-401a-8c77-903ef7ae8081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:44 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Volume 081bd5f5-3b98-42ed-b94b-79421a224435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081bd5f5-3b98-42ed-b94b-79421a224435', 'volume_size': 1} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2064818592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081bd5f5-3b98-42ed-b94b-79421a224435,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:44Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Creating volume 081bd5f5-3b98-42ed-b94b-79421a224435 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:44 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:49:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:44 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435 1073741824 Jul 11 18:49:44 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:45 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435 1073741824" returned: 0 in 1.042s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Flow 'volume_create_manager' (120c2f57-7af0-4703-912c-fe8586b58ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6731c6-fc3c-45c2-b3fc-948ea779d717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6731c6-fc3c-45c2-b3fc-948ea779d717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-61141637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84785f7-7a5a-44d4-a2c9-7a4d349de840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bbc3fcd5a4b2da73005b44c40cf9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:46Z,use_quota=True,user_id='05e5847e57504277b3c454319772c073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81777852-5e8a-4cc6-b1ba-5a476e774a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81777852-5e8a-4cc6-b1ba-5a476e774a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69501201-67a3-441f-b718-f599456aea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69501201-67a3-441f-b718-f599456aea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c84785f7-7a5a-44d4-a2c9-7a4d349de840', 'volume_name': 'volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a10df82-05c6-44a6-a1f4-1d179df6a2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a10df82-05c6-44a6-a1f4-1d179df6a2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4904f9-bb67-42d2-af59-3c05e5fbc83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:45 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Volume c84785f7-7a5a-44d4-a2c9-7a4d349de840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840', 'volume_size': 1} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:45 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435 Jul 11 18:49:45 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f9f5068d-4761-4fd2-b0c5-9f9644f7e8e0 req-2abec62e-765a-4680-8849-f018c5f6eeb6 tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:46 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435" returned: 0 in 0.713s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-61141637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84785f7-7a5a-44d4-a2c9-7a4d349de840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bbc3fcd5a4b2da73005b44c40cf9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:46Z,use_quota=True,user_id='05e5847e57504277b3c454319772c073',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Creating volume c84785f7-7a5a-44d4-a2c9-7a4d349de840 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:46 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b83199-2243-401a-8c77-903ef7ae8081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081bd5f5-3b98-42ed-b94b-79421a224435', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:46 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 1073741824 Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c45e98a-c5ff-4013-95bc-779146cb3f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:46 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:46 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Volume volume-081bd5f5-3b98-42ed-b94b-79421a224435 (081bd5f5-3b98-42ed-b94b-79421a224435): created successfully Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c45e98a-c5ff-4013-95bc-779146cb3f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (7f3b3a98-60e2-4edc-9685-b0ccc06f8827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:46 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b3b7003e-1c5d-4c6c-a0cb-8fc0d1c2591a tempest-VolumesGetTest-1169908432 None] Created volume successfully. Jul 11 18:49:47 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 1073741824" returned: 0 in 0.873s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:47 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 Jul 11 18:49:47 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:48 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840" returned: 0 in 0.691s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f9f5068d-4761-4fd2-b0c5-9f9644f7e8e0 req-2abec62e-765a-4680-8849-f018c5f6eeb6 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.124s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4904f9-bb67-42d2-af59-3c05e5fbc83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b705d2b-8579-4736-998e-7371de84bd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8ecd72-dde7-4df8-b635-4496d15d206d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f9f5068d-4761-4fd2-b0c5-9f9644f7e8e0 req-2abec62e-765a-4680-8849-f018c5f6eeb6 tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:48 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Volume volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 (c84785f7-7a5a-44d4-a2c9-7a4d349de840): created successfully Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b705d2b-8579-4736-998e-7371de84bd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Flow 'volume_create_manager' (120c2f57-7af0-4703-912c-fe8586b58ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:48 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2d83ed44-57d5-45ce-a73b-8141e276826c tempest-AttachVolumeTestJSON-365977217 None] Created volume successfully. Jul 11 18:49:48 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 Jul 11 18:49:48 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (f97fa19d-e5dc-47e6-b4f6-0f21844524cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b72cce-c2c2-4529-aed3-e3c4193c6176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b72cce-c2c2-4529-aed3-e3c4193c6176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-132758452',display_name='tempest-VolumesGetTest-Volume-522721827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1809f5c-0abd-415f-8769-6bbe026eb8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:48Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb309454-a24d-479c-8653-ef3b21762fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb309454-a24d-479c-8653-ef3b21762fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d22ba4-75f3-40df-baff-fda0a8665990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d22ba4-75f3-40df-baff-fda0a8665990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1809f5c-0abd-415f-8769-6bbe026eb8ed', 'volume_name': 'volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb492d6e-40a2-4e45-b01c-7f3aeb1cd20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb492d6e-40a2-4e45-b01c-7f3aeb1cd20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01005721-3e18-4935-8500-47d981aef7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:48 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Volume e1809f5c-0abd-415f-8769-6bbe026eb8ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed', 'volume_size': 1} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:48 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-f9f5068d-4761-4fd2-b0c5-9f9644f7e8e0 req-2abec62e-765a-4680-8849-f018c5f6eeb6 tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203" returned: 0 in 0.817s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-f9f5068d-4761-4fd2-b0c5-9f9644f7e8e0 req-2abec62e-765a-4680-8849-f018c5f6eeb6 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-132758452',display_name='tempest-VolumesGetTest-Volume-522721827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1809f5c-0abd-415f-8769-6bbe026eb8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:48Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Creating volume e1809f5c-0abd-415f-8769-6bbe026eb8ed {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:48 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:49:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:49 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed 1073741824 Jul 11 18:49:49 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:49 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f9f5068d-4761-4fd2-b0c5-9f9644f7e8e0 req-2abec62e-765a-4680-8849-f018c5f6eeb6 tempest-TestServerVolumeAttachmentScenario-508390035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2b7eef7-d8e3-4660-88f6-42403b557631', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:49:49 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-f9f5068d-4761-4fd2-b0c5-9f9644f7e8e0 req-2abec62e-765a-4680-8849-f018c5f6eeb6 tempest-TestServerVolumeAttachmentScenario-508390035 None] attachment_update completed successfully. Jul 11 18:49:49 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed 1073741824" returned: 0 in 0.841s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:49 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed Jul 11 18:49:49 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:50 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed" returned: 0 in 0.644s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:49:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01005721-3e18-4935-8500-47d981aef7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d73b3d0-c660-4b10-810c-915da8c295c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Volume volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed (e1809f5c-0abd-415f-8769-6bbe026eb8ed): created successfully Jul 11 18:49:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d73b3d0-c660-4b10-810c-915da8c295c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (f97fa19d-e5dc-47e6-b4f6-0f21844524cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:50 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-69bec54a-a406-4468-a198-8df23d6d5802 tempest-VolumesGetTest-1169908432 None] Created volume successfully. Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:51 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:49:51 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-e1809f5c-0abd-415f-8769-6bbe026eb8ed-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Lock "cinder-e1809f5c-0abd-415f-8769-6bbe026eb8ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-quobyte-e1809f5c-0abd-415f-8769-6bbe026eb8ed" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-e1809f5c-0abd-415f-8769-6bbe026eb8ed" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e44b63e-b886-4268-9a47-325f3c1528b5]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-005faff5-09d9-43d4-baf9-1e48ef6f51ac req-224e6ec6-086b-42e9-b74e-d8487f7c1879 tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-005faff5-09d9-43d4-baf9-1e48ef6f51ac req-224e6ec6-086b-42e9-b74e-d8487f7c1879 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbc7a1d-d558-4bb2-81b6-3d63637d84bd]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-005faff5-09d9-43d4-baf9-1e48ef6f51ac req-224e6ec6-086b-42e9-b74e-d8487f7c1879 tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:52 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed Jul 11 18:49:52 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:52 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 Jul 11 18:49:52 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:52 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.773s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:49:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:49:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:49:52 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed" returned: 0 in 0.903s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:52 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed Jul 11 18:49:52 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:53 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-005faff5-09d9-43d4-baf9-1e48ef6f51ac req-224e6ec6-086b-42e9-b74e-d8487f7c1879 tempest-AttachVolumeTestJSON-365977217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840" returned: 0 in 1.063s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-005faff5-09d9-43d4-baf9-1e48ef6f51ac req-224e6ec6-086b-42e9-b74e-d8487f7c1879 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.081s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-005faff5-09d9-43d4-baf9-1e48ef6f51ac req-224e6ec6-086b-42e9-b74e-d8487f7c1879 tempest-AttachVolumeTestJSON-365977217 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32f5ad06-2678-4a41-ba69-53c25af24986', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:49:53 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-005faff5-09d9-43d4-baf9-1e48ef6f51ac req-224e6ec6-086b-42e9-b74e-d8487f7c1879 tempest-AttachVolumeTestJSON-365977217 None] attachment_update completed successfully. Jul 11 18:49:53 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e1809f5c-0abd-415f-8769-6bbe026eb8ed" returned: 0 in 1.016s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-e1809f5c-0abd-415f-8769-6bbe026eb8ed" released by "delete_volume" :: held 1.982s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Created reservations ['0f2ac303-f8d8-4332-84f1-6ba5cd0d055c', 'b9346d44-bc1b-46ca-83de-867db76571ca', '29ceb602-5127-4420-a37c-67a52bb3ebb0', '3603c199-fcbb-4723-86e3-f26850cf52e1'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:54 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:49:54 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-081bd5f5-3b98-42ed-b94b-79421a224435-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Lock "cinder-081bd5f5-3b98-42ed-b94b-79421a224435-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-quobyte-081bd5f5-3b98-42ed-b94b-79421a224435" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:49:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-081bd5f5-3b98-42ed-b94b-79421a224435" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:49:54 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e0401c-00b5-4ae5-a3e5-ff3dbef7bdeb]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:49:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:54 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435 Jul 11 18:49:54 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:55 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.238s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:55 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Deleted volume successfully. Jul 11 18:49:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2f399fbb-991b-4a13-a668-2fa176c9e098 tempest-VolumesGetTest-1169908432 None] Lock "cinder-e1809f5c-0abd-415f-8769-6bbe026eb8ed-delete_volume" released by "delete_volume" :: held 3.454s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-a4fc7ece-b529-4d0a-b191-47ba05e97b53 req-ce6f27e6-86d6-4d31-ae5a-8f46f7497c7f tempest-TestServerVolumeAttachmentScenario-508390035 None] Terminate volume connection completed successfully. Jul 11 18:49:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-a4fc7ece-b529-4d0a-b191-47ba05e97b53 req-ce6f27e6-86d6-4d31-ae5a-8f46f7497c7f tempest-TestServerVolumeAttachmentScenario-508390035 None] Deleting attachment a2b7eef7-d8e3-4660-88f6-42403b557631. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:49:55 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435" returned: 0 in 1.080s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:55 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435 Jul 11 18:49:55 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:56 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-081bd5f5-3b98-42ed-b94b-79421a224435" returned: 0 in 0.832s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-081bd5f5-3b98-42ed-b94b-79421a224435" released by "delete_volume" :: held 2.019s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:56 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Created reservations ['1ac4a96b-1e81-4247-90d7-61e1a3915b94', '6c6d199d-1573-4a08-b73f-61a552486eba', '3e12a10d-1374-452b-88bd-d7e8b9459f3a', '641f9afe-f184-4986-9d52-0c7ce4bcb8d4'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:49:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:56 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:49:56 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:57 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.772s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:57 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:49:57 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Deleted volume successfully. Jul 11 18:49:57 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d44801b-9836-4edf-9f9a-9b0b393d89cd tempest-VolumesGetTest-1169908432 None] Lock "cinder-081bd5f5-3b98-42ed-b94b-79421a224435-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (ad348d98-03aa-498e-a48a-d0723c7a1691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4cfcf21-a671-4789-81ed-290767a49224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4cfcf21-a671-4789-81ed-290767a49224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-528318427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeee213f-2b5e-497d-853c-ca340ec5a763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:58Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a230c298-98ea-4757-9305-6c8e9051c3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a230c298-98ea-4757-9305-6c8e9051c3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e44029-ca28-46bd-8c1f-47597eb165fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e44029-ca28-46bd-8c1f-47597eb165fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeee213f-2b5e-497d-853c-ca340ec5a763', 'volume_name': 'volume-eeee213f-2b5e-497d-853c-ca340ec5a763', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c7568c-762f-461e-a4f5-133c3fd82e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c7568c-762f-461e-a4f5-133c3fd82e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7314f4-6eff-4eae-8a2d-e20aa505cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:49:58 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Volume eeee213f-2b5e-497d-853c-ca340ec5a763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeee213f-2b5e-497d-853c-ca340ec5a763', 'volume_size': 1} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-528318427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeee213f-2b5e-497d-853c-ca340ec5a763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:49:58Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Creating volume eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:49:58 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:49:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:58 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 1073741824 Jul 11 18:49:58 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:49:59 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-84a45541-05c5-4eba-9fdb-a3563362fc98 req-09e77c3b-1ef3-4d92-a340-6113e7d4a75c tempest-TestServerVolumeAttachmentScenario-508390035 None] Terminate volume connection completed successfully. Jul 11 18:49:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-84a45541-05c5-4eba-9fdb-a3563362fc98 req-09e77c3b-1ef3-4d92-a340-6113e7d4a75c tempest-TestServerVolumeAttachmentScenario-508390035 None] Deleting attachment 7012e233-da70-4010-a1d5-8ae7a636d7b5. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:49:59 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Jul 11 18:49:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 1073741824" returned: 0 in 1.290s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:49:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:49:59 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 Jul 11 18:49:59 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:00 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-d9eb8f34-823e-464c-8658-4b5e85460e05 req-e6a16473-295f-427b-931b-bdaca8db63f4 tempest-AttachVolumeTestJSON-365977217 None] Terminate volume connection completed successfully. Jul 11 18:50:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-d9eb8f34-823e-464c-8658-4b5e85460e05 req-e6a16473-295f-427b-931b-bdaca8db63f4 tempest-AttachVolumeTestJSON-365977217 None] Deleting attachment 0a4b87f4-09f7-4032-b0c9-fb03a94a5263. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:50:00 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763" returned: 0 in 0.717s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:00 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:50:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7314f4-6eff-4eae-8a2d-e20aa505cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeee213f-2b5e-497d-853c-ca340ec5a763', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2bf11c-8932-495e-a0e7-7c87a5bdb9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:00 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Volume volume-eeee213f-2b5e-497d-853c-ca340ec5a763 (eeee213f-2b5e-497d-853c-ca340ec5a763): created successfully Jul 11 18:50:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2bf11c-8932-495e-a0e7-7c87a5bdb9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (ad348d98-03aa-498e-a48a-d0723c7a1691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:00 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-593bf721-839d-4241-9f4a-599fb0eb4da2 tempest-VolumesGetTest-1169908432 None] Created volume successfully. Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (75d4b8bb-850a-451f-8ffc-0d30cdfa9c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c2b56c-2048-46df-933c-72982cad0533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c2b56c-2048-46df-933c-72982cad0533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1995000420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0152b416-28cc-4689-ba19-c20f706cc381,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=eeee213f-2b5e-497d-853c-ca340ec5a763,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:02Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671befbf-d5e0-4acf-831d-bf5cbc24e3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671befbf-d5e0-4acf-831d-bf5cbc24e3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538fbdd2-a5fe-42b7-92c9-8373989472e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538fbdd2-a5fe-42b7-92c9-8373989472e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0152b416-28cc-4689-ba19-c20f706cc381', 'volume_name': 'volume-0152b416-28cc-4689-ba19-c20f706cc381', 'volume_size': 1, 'source_volid': 'eeee213f-2b5e-497d-853c-ca340ec5a763', 'source_volstatus': 'available'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c81c435-42bb-4082-b9bf-51efe61e2105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c81c435-42bb-4082-b9bf-51efe61e2105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857f4ad7-1665-429a-bb45-69bcdd53e9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:02 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Volume 0152b416-28cc-4689-ba19-c20f706cc381: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0152b416-28cc-4689-ba19-c20f706cc381', 'volume_size': 1, 'source_volid': 'eeee213f-2b5e-497d-853c-ca340ec5a763', 'source_volstatus': 'available'} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:02 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Cloning volume eeee213f-2b5e-497d-853c-ca340ec5a763 to volume 0152b416-28cc-4689-ba19-c20f706cc381 Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Creating offline snapshot d1d427be-8d81-4cf1-bdeb-2946fc7f1847 of volume eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[debe1a77-6cfb-4f15-9e89-eb9e401e11b4]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:02 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 Jul 11 18:50:02 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:03 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763" returned: 0 in 0.971s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:03 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 1G Jul 11 18:50:03 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:04 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-5d8cf26b-696a-45d5-8a4b-3c0471bab09d req-aa5ca736-ad37-46eb-b901-df7349430b78 tempest-AttachVolumeTestJSON-365977217 None] Terminate volume connection completed successfully. Jul 11 18:50:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-5d8cf26b-696a-45d5-8a4b-3c0471bab09d req-aa5ca736-ad37-46eb-b901-df7349430b78 tempest-AttachVolumeTestJSON-365977217 None] Deleting attachment 32f5ad06-2678-4a41-ba69-53c25af24986. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:50:04 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 1G" returned: 0 in 1.347s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeee213f-2b5e-497d-853c-ca340ec5a763 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:04 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeee213f-2b5e-497d-853c-ca340ec5a763 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 Jul 11 18:50:04 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:05 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eeee213f-2b5e-497d-853c-ca340ec5a763 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847" returned: 0 in 0.974s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:05 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 is being set with open permissions: ugo+rw Jul 11 18:50:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:05 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 Jul 11 18:50:05 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Flow 'volume_create_manager' (1e62106d-5a04-4d74-a5e5-68ce586ef065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610b9abd-9d07-4156-9f5a-47cc816106fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610b9abd-9d07-4156-9f5a-47cc816106fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-675805334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc696ad-c450-4e26-a8b6-4879e1119c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5724e7922f1d4e3aac0d90d90e8105b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:06Z,use_quota=True,user_id='81e2336569d64d92bffb9c78db2e5c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cda8e8-c803-4909-a430-170b74f59635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cda8e8-c803-4909-a430-170b74f59635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0200cc4b-ca28-41a9-9062-9be301a989ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0200cc4b-ca28-41a9-9062-9be301a989ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc696ad-c450-4e26-a8b6-4879e1119c01', 'volume_name': 'volume-cfc696ad-c450-4e26-a8b6-4879e1119c01', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215f2f5e-e381-4201-9fa2-ba2d0fef9231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215f2f5e-e381-4201-9fa2-ba2d0fef9231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4aef8f7-5f8e-411f-a559-b7351fbc0b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:06 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Volume cfc696ad-c450-4e26-a8b6-4879e1119c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc696ad-c450-4e26-a8b6-4879e1119c01', 'volume_size': 1} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:06 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847" returned: 0 in 1.001s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:06 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.info Jul 11 18:50:06 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:07 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.info" returned: 0 in 0.840s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:07 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.info is being set with open permissions: ugo+rw Jul 11 18:50:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:07 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.info Jul 11 18:50:07 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:08 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.info" returned: 0 in 0.696s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-quobyte-0152b416-28cc-4689-ba19-c20f706cc381" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-0152b416-28cc-4689-ba19-c20f706cc381" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] snapshot: d1d427be-8d81-4cf1-bdeb-2946fc7f1847, volume: 0152b416-28cc-4689-ba19-c20f706cc381, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2901a836-d352-45af-94ad-c333cc613a4e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:08 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 Jul 11 18:50:08 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:09 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847" returned: 0 in 1.425s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eeee213f-2b5e-497d-853c-ca340ec5a763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:50:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:50:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:50:09 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[90db1bef-9106-4760-abc0-38bcb886e9f2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:09 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 Jul 11 18:50:09 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "cinder-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "cinder-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "cinder-quobyte-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "cinder-quobyte-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:10 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8b45e8-5d6e-4547-8f2f-496ac07b6397]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:10 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763" returned: 0 in 1.184s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:10 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:50:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:10 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 Jul 11 18:50:10 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:11 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 Jul 11 18:50:11 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:11 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203" returned: 0 in 0.911s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:11 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203 Jul 11 18:50:11 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:13 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203" returned: 0 in 1.565s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "cinder-quobyte-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203" released by "delete_volume" :: held 2.554s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:13 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Created reservations ['6766af34-3233-4b3f-8c2f-63400f005b86', '50ad0998-a812-4535-b49a-80fbe05f7453', '5b9c6864-7e5d-4383-86d9-7bbb3a67e0fb', '4a2de60b-6ca5-4843-9159-b6386250025a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:14 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:50:14 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "cinder-78208805-1785-4f10-926f-7f960535a3a9-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "cinder-78208805-1785-4f10-926f-7f960535a3a9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "cinder-quobyte-78208805-1785-4f10-926f-7f960535a3a9" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "cinder-quobyte-78208805-1785-4f10-926f-7f960535a3a9" acquired by "delete_volume" :: waited 0.055s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:15 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d1ef33-3a89-444e-a5e0-81b27eac614f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:15 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.364s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:15 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Deleted volume successfully. Jul 11 18:50:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e9967c3-fd8b-4123-bbed-ed04f7a43e12 tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "cinder-0d38ea90-cd2b-4efb-bdd4-5af4f7af5203-delete_volume" released by "delete_volume" :: held 4.469s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:15 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 Jul 11 18:50:15 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "cinder-c84785f7-7a5a-44d4-a2c9-7a4d349de840-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-c84785f7-7a5a-44d4-a2c9-7a4d349de840-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "cinder-quobyte-c84785f7-7a5a-44d4-a2c9-7a4d349de840" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-quobyte-c84785f7-7a5a-44d4-a2c9-7a4d349de840" acquired by "delete_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e119650-cfcd-41b1-8838-5324d10cf5de]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:17 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9" returned: 0 in 2.539s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:17 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9 Jul 11 18:50:17 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:17 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 Jul 11 18:50:17 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:17 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381" returned: 0 in 6.875s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[391506aa-5c6e-495d-a1d7-240569b50694]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:17 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 Jul 11 18:50:17 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:18 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-78208805-1785-4f10-926f-7f960535a3a9" returned: 0 in 0.694s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "cinder-quobyte-78208805-1785-4f10-926f-7f960535a3a9" released by "delete_volume" :: held 3.357s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:18 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840" returned: 0 in 0.851s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Created reservations ['954c87e2-658b-4575-9b1d-efc25fc8a08d', 'a48d5af9-7e4d-4b7b-800c-c50f32572296', 'd8ec0867-2e8f-415e-aad7-e54e45dc9b04', 'd2e21218-a919-4bbf-ac53-c77816f1abcc'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:18 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840 Jul 11 18:50:18 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:18 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:50:18 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:18 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763" returned: 0 in 0.979s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:50:18 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Converted 1024.00 MB image at 148.91 MB/s Jul 11 18:50:18 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 is being set with open permissions: ugo+rw Jul 11 18:50:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:18 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 Jul 11 18:50:18 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:19 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c84785f7-7a5a-44d4-a2c9-7a4d349de840" returned: 0 in 0.705s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-quobyte-c84785f7-7a5a-44d4-a2c9-7a4d349de840" released by "delete_volume" :: held 1.635s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Created reservations ['83d19600-0522-4c2a-ae30-c79915ce172c', 'f9cb02b7-aea5-44aa-a5e9-1451509d5e07', '7bea51d3-7190-41f9-a004-580b0ce46b2f', '480133d9-d84b-454c-b32b-ba842e4ff0cc'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:19 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.662s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:19 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Deleted volume successfully. Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3c687e71-ebb5-4e60-85c0-bae914c7e4ef tempest-TestServerVolumeAttachmentScenario-508390035 None] Lock "cinder-78208805-1785-4f10-926f-7f960535a3a9-delete_volume" released by "delete_volume" :: held 4.421s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:19 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:50:19 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:19 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381" returned: 0 in 0.712s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-0152b416-28cc-4689-ba19-c20f706cc381" released by "_copy_volume_from_snapshot" :: held 11.297s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-quobyte-d1d427be-8d81-4cf1-bdeb-2946fc7f1847" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-d1d427be-8d81-4cf1-bdeb-2946fc7f1847" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Deleting offline snapshot d1d427be-8d81-4cf1-bdeb-2946fc7f1847 of volume eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] snapshot_file for this snap is: volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "cinder-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a4dbb4-698f-4c64-8883-51ef20d99cc1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "cinder-quobyte-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-quobyte-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:19 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 Jul 11 18:50:19 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc86485-8723-4094-b649-4da478575a34]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:19 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d Jul 11 18:50:19 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:20 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.740s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:20 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Deleted volume successfully. Jul 11 18:50:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6cacca38-6cb6-4e80-b152-2f1126dc6b9c tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-c84785f7-7a5a-44d4-a2c9-7a4d349de840-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:20 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847" returned: 0 in 0.963s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eeee213f-2b5e-497d-853c-ca340ec5a763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:50:20 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb60dc8-4a1b-46c4-b334-c1b9d1c008cc]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:20 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 Jul 11 18:50:20 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:20 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d" returned: 0 in 0.996s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:20 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d Jul 11 18:50:20 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:21 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763" returned: 0 in 0.899s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:21 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 Jul 11 18:50:21 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:21 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d" returned: 0 in 0.819s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-quobyte-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d" released by "delete_volume" :: held 1.877s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=95,cinder:SELECT=79,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Created reservations ['d5b30015-39e2-4802-824e-4f2968da3848', 'de1dba27-df9e-4bb9-8431-679a0e38cecc', 'fe449fab-07c4-45ca-8434-7fb9a3896b1f', '0459fa16-fcde-41c5-b684-61b07b811577'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:21 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:50:21 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "cinder-caf13309-a724-4745-973a-307d59a316ff-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-caf13309-a724-4745-973a-307d59a316ff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "cinder-quobyte-caf13309-a724-4745-973a-307d59a316ff" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-quobyte-caf13309-a724-4745-973a-307d59a316ff" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad45b98-8e1e-4cc8-a471-7411a1d881bf]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:22 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff Jul 11 18:50:22 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:22 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847" returned: 0 in 1.240s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:22 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847 Jul 11 18:50:22 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:22 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.047s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:22 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Deleted volume successfully. Jul 11 18:50:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ad22e3-24b2-4c3f-81ba-17310017f515 tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-7c6ce3ec-3e7c-4f11-9747-668cf6b2946d-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:23 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff" returned: 0 in 1.041s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:23 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff Jul 11 18:50:23 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:23 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763.d1d427be-8d81-4cf1-bdeb-2946fc7f1847" returned: 0 in 0.767s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-d1d427be-8d81-4cf1-bdeb-2946fc7f1847" released by "_delete_snapshot" :: held 4.010s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=103,cinder:SELECT=98,cinder:INSERT=21,cinder:DELETE=10 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.372s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.258s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-675805334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc696ad-c450-4e26-a8b6-4879e1119c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5724e7922f1d4e3aac0d90d90e8105b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:06Z,use_quota=True,user_id='81e2336569d64d92bffb9c78db2e5c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Creating volume cfc696ad-c450-4e26-a8b6-4879e1119c01 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:50:23 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857f4ad7-1665-429a-bb45-69bcdd53e9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0152b416-28cc-4689-ba19-c20f706cc381', 'volume_size': 1, 'source_volid': 'eeee213f-2b5e-497d-853c-ca340ec5a763', 'source_volstatus': 'available'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a819f1-6d49-4f21-bb6e-3eaf153260d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:23 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 1073741824 Jul 11 18:50:23 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:23 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Volume volume-0152b416-28cc-4689-ba19-c20f706cc381 (0152b416-28cc-4689-ba19-c20f706cc381): created successfully Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a819f1-6d49-4f21-bb6e-3eaf153260d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (75d4b8bb-850a-451f-8ffc-0d30cdfa9c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:23 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2172cd53-c058-4033-ab2f-71faae5c3b56 tempest-VolumesGetTest-1169908432 None] Created volume successfully. Jul 11 18:50:24 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-caf13309-a724-4745-973a-307d59a316ff" returned: 0 in 0.745s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-quobyte-caf13309-a724-4745-973a-307d59a316ff" released by "delete_volume" :: held 1.843s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Created reservations ['bee84a50-e9b4-468f-9fa1-3499e01d2fa4', '1893df0b-eb19-4532-b485-66c42e56eb04', 'beb8de6f-807a-456b-a5c9-9032dc672a21', '6f2ab0ab-38d4-4c55-bd7a-92fa9fba6cb2'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:24 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:50:24 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:24 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 1073741824" returned: 0 in 1.023s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:24 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 Jul 11 18:50:24 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:25 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.224s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:25 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Deleted volume successfully. Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e4ba3d1-c8c9-4034-9c3d-f18f161c4dca tempest-AttachVolumeTestJSON-365977217 None] Lock "cinder-caf13309-a724-4745-973a-307d59a316ff-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (94c7b6e9-3a50-4319-bb20-dad2465bc1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8962508e-a5fb-4e89-a6a1-0d68757529ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8962508e-a5fb-4e89-a6a1-0d68757529ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-395039206',display_name='tempest-VolumesGetTest-Volume-2084833470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14071684-b2ee-4a2a-bbc6-9d60a859a811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:26Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b50595b-3c4d-4d9c-a152-0eb3bd85f5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b50595b-3c4d-4d9c-a152-0eb3bd85f5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e19d064-629d-45af-86f9-3646e054588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e19d064-629d-45af-86f9-3646e054588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14071684-b2ee-4a2a-bbc6-9d60a859a811', 'volume_name': 'volume-14071684-b2ee-4a2a-bbc6-9d60a859a811', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69836df2-c208-466a-aa3c-e100de3af610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69836df2-c208-466a-aa3c-e100de3af610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f171c9-6493-49fd-92a2-7622784fc8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:25 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Volume 14071684-b2ee-4a2a-bbc6-9d60a859a811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14071684-b2ee-4a2a-bbc6-9d60a859a811', 'volume_size': 1} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:25 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01" returned: 0 in 1.135s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] <== create_volume: return (2216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-395039206',display_name='tempest-VolumesGetTest-Volume-2084833470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14071684-b2ee-4a2a-bbc6-9d60a859a811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:26Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Creating volume 14071684-b2ee-4a2a-bbc6-9d60a859a811 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:50:25 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:25 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811 1073741824 Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4aef8f7-5f8e-411f-a559-b7351fbc0b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc696ad-c450-4e26-a8b6-4879e1119c01', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:25 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cdaef3-4833-406b-b696-dc76e7a68597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:25 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Volume volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 (cfc696ad-c450-4e26-a8b6-4879e1119c01): created successfully Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35cdaef3-4833-406b-b696-dc76e7a68597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Flow 'volume_create_manager' (1e62106d-5a04-4d74-a5e5-68ce586ef065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:25 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f6620cba-9d4a-4046-8b39-862737b7f1be tempest-TestMinimumBasicScenario-2012652068 None] Created volume successfully. Jul 11 18:50:26 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811 1073741824" returned: 0 in 1.062s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:27 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811 Jul 11 18:50:27 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:27 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811" returned: 0 in 0.818s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:50:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f171c9-6493-49fd-92a2-7622784fc8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14071684-b2ee-4a2a-bbc6-9d60a859a811', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d7fb6b-99ca-43da-9edc-36a9fa49a246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:27 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Volume volume-14071684-b2ee-4a2a-bbc6-9d60a859a811 (14071684-b2ee-4a2a-bbc6-9d60a859a811): created successfully Jul 11 18:50:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d7fb6b-99ca-43da-9edc-36a9fa49a246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (94c7b6e9-3a50-4319-bb20-dad2465bc1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:27 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-906c5297-4305-4676-9eb4-85d8f7b6e777 tempest-VolumesGetTest-1169908432 None] Created volume successfully. Jul 11 18:50:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-14071684-b2ee-4a2a-bbc6-9d60a859a811-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Lock "cinder-14071684-b2ee-4a2a-bbc6-9d60a859a811-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-quobyte-14071684-b2ee-4a2a-bbc6-9d60a859a811" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-14071684-b2ee-4a2a-bbc6-9d60a859a811" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:28 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b223f9b-9749-4705-8891-d41c8eb93023]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:29 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811 Jul 11 18:50:29 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-422d2e82-443c-4020-8cfd-ccdeb8cd7d72 req-7d059ae2-b5b1-4c30-a334-79d1b44a3bab tempest-TestMinimumBasicScenario-2012652068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-422d2e82-443c-4020-8cfd-ccdeb8cd7d72 req-7d059ae2-b5b1-4c30-a334-79d1b44a3bab tempest-TestMinimumBasicScenario-2012652068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:29 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e0a387-5721-4b8b-903a-9655d863f2fb]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-422d2e82-443c-4020-8cfd-ccdeb8cd7d72 req-7d059ae2-b5b1-4c30-a334-79d1b44a3bab tempest-TestMinimumBasicScenario-2012652068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:29 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 Jul 11 18:50:29 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:29 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811" returned: 0 in 0.972s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:30 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811 Jul 11 18:50:30 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:30 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-422d2e82-443c-4020-8cfd-ccdeb8cd7d72 req-7d059ae2-b5b1-4c30-a334-79d1b44a3bab tempest-TestMinimumBasicScenario-2012652068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01" returned: 0 in 0.936s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-422d2e82-443c-4020-8cfd-ccdeb8cd7d72 req-7d059ae2-b5b1-4c30-a334-79d1b44a3bab tempest-TestMinimumBasicScenario-2012652068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.962s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-422d2e82-443c-4020-8cfd-ccdeb8cd7d72 req-7d059ae2-b5b1-4c30-a334-79d1b44a3bab tempest-TestMinimumBasicScenario-2012652068 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-cfc696ad-c450-4e26-a8b6-4879e1119c01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3e0d265-a46f-4c9a-9969-c4f7dd3de2dc', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:50:30 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-422d2e82-443c-4020-8cfd-ccdeb8cd7d72 req-7d059ae2-b5b1-4c30-a334-79d1b44a3bab tempest-TestMinimumBasicScenario-2012652068 None] attachment_update completed successfully. Jul 11 18:50:30 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-14071684-b2ee-4a2a-bbc6-9d60a859a811" returned: 0 in 0.873s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-14071684-b2ee-4a2a-bbc6-9d60a859a811" released by "delete_volume" :: held 1.912s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Created reservations ['391a1936-a205-4e94-a56e-e810d9090133', '714f50af-843f-4d25-844a-d13323ea65ad', 'dd1e9bc0-22e9-41a7-8be7-4e323f404068', '58bfb888-c548-4de2-90e3-b4f89da759c4'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:31 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:50:31 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-0152b416-28cc-4689-ba19-c20f706cc381-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Lock "cinder-0152b416-28cc-4689-ba19-c20f706cc381-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-quobyte-0152b416-28cc-4689-ba19-c20f706cc381" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-0152b416-28cc-4689-ba19-c20f706cc381" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:31 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a42205e-585b-4068-a677-392419f769ed]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:31 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 Jul 11 18:50:31 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:31 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.887s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:31 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:31 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Deleted volume successfully. Jul 11 18:50:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9e993712-c1a8-41f4-a435-6e7488bc666e tempest-VolumesGetTest-1169908432 None] Lock "cinder-14071684-b2ee-4a2a-bbc6-9d60a859a811-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:32 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381" returned: 0 in 0.946s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:32 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381 Jul 11 18:50:32 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:33 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0152b416-28cc-4689-ba19-c20f706cc381" returned: 0 in 0.741s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-0152b416-28cc-4689-ba19-c20f706cc381" released by "delete_volume" :: held 1.749s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Created reservations ['a0c43df6-f3c7-41b7-b249-108a13f60f9c', 'c3fd8214-6e17-45c7-b188-0c69222fa15b', '1c9f0a36-4880-4d88-a866-998b06f4d991', 'c0dbb436-0b9c-4f23-82e7-834bd4949f37'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:33 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:50:33 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-eeee213f-2b5e-497d-853c-ca340ec5a763-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Lock "cinder-eeee213f-2b5e-497d-853c-ca340ec5a763-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-quobyte-eeee213f-2b5e-497d-853c-ca340ec5a763" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-eeee213f-2b5e-497d-853c-ca340ec5a763" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:34 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1aab10-8fce-4254-bb79-0d0847a696e0]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:34 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 Jul 11 18:50:34 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:34 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.835s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:34 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:34 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Deleted volume successfully. Jul 11 18:50:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9124e3d9-fbc8-4c41-9d5d-3fc15e91d9a2 tempest-VolumesGetTest-1169908432 None] Lock "cinder-0152b416-28cc-4689-ba19-c20f706cc381-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:34 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763" returned: 0 in 0.923s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:34 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763 Jul 11 18:50:34 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:35 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-eeee213f-2b5e-497d-853c-ca340ec5a763" returned: 0 in 0.727s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-eeee213f-2b5e-497d-853c-ca340ec5a763" released by "delete_volume" :: held 1.752s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:35 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Created reservations ['286b4d31-c5a3-4e00-93bc-4c695c636559', '3ca5ad0e-c19e-4f90-93bc-0003b2f428a8', '3004ac61-6fba-46dc-80fa-d47b95e44a7e', '50f95584-2983-44c3-a84f-210c8264da5f'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:35 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:50:35 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:36 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.941s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:36 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Deleted volume successfully. Jul 11 18:50:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e87a9813-4289-4e17-998d-2ab7d12a0e95 tempest-VolumesGetTest-1169908432 None] Lock "cinder-eeee213f-2b5e-497d-853c-ca340ec5a763-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (95d034aa-1a27-4278-be97-eddf0992084e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e4d1fd-dc96-4c13-9913-150a680a3365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e4d1fd-dc96-4c13-9913-150a680a3365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2072867951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795a6a67-da4b-4b74-a0b4-0e701a428bdb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:37Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5189bb1-4ee6-47b3-80b6-2ac3b1023c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5189bb1-4ee6-47b3-80b6-2ac3b1023c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ee7bee-81cd-4975-8371-700004ae0368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.image.glance [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Creating Keystone auth plugin from conf {{(pid=87411) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ee7bee-81cd-4975-8371-700004ae0368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '795a6a67-da4b-4b74-a0b4-0e701a428bdb', 'volume_name': 'volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c685c5a6-0157-451b-8151-eb2d003663ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c685c5a6-0157-451b-8151-eb2d003663ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e664716f-2a38-480f-a6b8-c769cd3e97a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:37 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Volume 795a6a67-da4b-4b74-a0b4-0e701a428bdb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 18:50:37 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Trying to clone 795a6a67-da4b-4b74-a0b4-0e701a428bdb from image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]). {{(pid=87411) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:50:38 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:50:38 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Image download 20.69 MB at 20.69 MB/s Jul 11 18:50:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f78fdf-bd37-470a-af7c-6d3853986069]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:38 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD Jul 11 18:50:38 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:39 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD" returned: 0 in 0.922s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Temporary image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 is fetched for user 9ca178b64943497aa443af8ecf931cb3. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f65660-b799-4cb1-bdcc-78efc5798550]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:39 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD Jul 11 18:50:39 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:39 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD" returned: 0 in 0.794s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2072867951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795a6a67-da4b-4b74-a0b4-0e701a428bdb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:37Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Creating volume 795a6a67-da4b-4b74-a0b4-0e701a428bdb {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:50:39 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:50:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:40 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb 1073741824 Jul 11 18:50:40 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:40 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb 1073741824" returned: 0 in 1.004s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:41 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb Jul 11 18:50:41 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:41 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb" returned: 0 in 0.723s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:50:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:41 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Attempting download of 7016bfdd-2d92-4c05-bebe-d2bb20b14820 ((None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}])) to volume 795a6a67-da4b-4b74-a0b4-0e701a428bdb. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:50:41 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5a6114-acc3-4de6-9659-7f2c678fb953]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_pz7me942 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:42 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_pz7me942 Jul 11 18:50:42 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:42 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_pz7me942" returned: 0 in 0.935s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_pz7me942 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:42 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_pz7me942 Jul 11 18:50:42 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:43 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_pz7me942" returned: 1 in 0.883s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_pz7me942' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:50:43 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b03bde-6182-43c4-a696-57fa529a6113]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:43 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD Jul 11 18:50:43 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:44 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD" returned: 0 in 0.913s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:44 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] 7016bfdd-2d92-4c05-bebe-d2bb20b14820 was qcow2, converting to raw {{(pid=87411) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:50:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:44 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb Jul 11 18:50:44 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:47 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb" returned: 0 in 2.411s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:47 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_codrh_34devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:50:47 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Converted 112.00 MB image at 46.42 MB/s Jul 11 18:50:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:47 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb 1G Jul 11 18:50:47 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:48 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb 1G" returned: 0 in 0.976s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cabbd27-f26d-48cc-9040-310fd3f2df4f]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:48 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb Jul 11 18:50:48 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:49 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb" returned: 0 in 1.068s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:49 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb Jul 11 18:50:49 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:50 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb" returned: 1 in 0.876s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Downloaded image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 ((None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}])) to volume 795a6a67-da4b-4b74-a0b4-0e701a428bdb successfully. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Temporary image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 for user 9ca178b64943497aa443af8ecf931cb3 is deleted. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Marking volume 795a6a67-da4b-4b74-a0b4-0e701a428bdb as bootable. {{(pid=87411) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Copying metadata from image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 to 795a6a67-da4b-4b74-a0b4-0e701a428bdb. {{(pid=87411) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Creating volume glance metadata for volume 795a6a67-da4b-4b74-a0b4-0e701a428bdb backed by image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87411) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e664716f-2a38-480f-a6b8-c769cd3e97a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d87342-d17b-447b-8c4f-f88223294282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Volume volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb (795a6a67-da4b-4b74-a0b4-0e701a428bdb): created successfully Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d87342-d17b-447b-8c4f-f88223294282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (95d034aa-1a27-4278-be97-eddf0992084e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:50 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e58cf6bd-9d15-4d4e-aba0-8945463c3d70 tempest-VolumesGetTest-1169908432 None] Created volume successfully. Jul 11 18:50:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:50:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:51 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:50:51 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (93c32353-df68-44f8-aa5e-b0c5916cf0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72aa499-374f-4e72-8381-3d1997e6f5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72aa499-374f-4e72-8381-3d1997e6f5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-377667463',display_name='tempest-VolumesGetTest-Volume-352166274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fbc4eda-2535-46ac-b58c-862792bc8f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:52Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3070535-2883-43af-a73d-74a95c81764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3070535-2883-43af-a73d-74a95c81764e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe9bb3e-7b82-47a8-996d-a72bbc984979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe9bb3e-7b82-47a8-996d-a72bbc984979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fbc4eda-2535-46ac-b58c-862792bc8f4d', 'volume_name': 'volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c4dc9c-f639-4078-9a30-5250b166d6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c4dc9c-f639-4078-9a30-5250b166d6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2623cadd-bde5-4749-a931-e649e44eb2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:52 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Volume 8fbc4eda-2535-46ac-b58c-862792bc8f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d', 'volume_size': 1} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:50:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-377667463',display_name='tempest-VolumesGetTest-Volume-352166274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fbc4eda-2535-46ac-b58c-862792bc8f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ece5ecd39941be8e8c464dc42539d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:50:52Z,use_quota=True,user_id='9ca178b64943497aa443af8ecf931cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Creating volume 8fbc4eda-2535-46ac-b58c-862792bc8f4d {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:50:52 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:52 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d 1073741824 Jul 11 18:50:52 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:52 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.003s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:50:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:50:53 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d 1073741824" returned: 0 in 0.902s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:53 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d Jul 11 18:50:53 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:53 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d" returned: 0 in 0.750s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:50:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2623cadd-bde5-4749-a931-e649e44eb2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5801dab3-004f-4432-89b9-c0522ad95903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:50:53 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Volume volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d (8fbc4eda-2535-46ac-b58c-862792bc8f4d): created successfully Jul 11 18:50:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5801dab3-004f-4432-89b9-c0522ad95903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:50:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Flow 'volume_create_manager' (93c32353-df68-44f8-aa5e-b0c5916cf0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:50:53 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-96d43ff8-1953-4fd1-9599-6d4446106285 tempest-VolumesGetTest-1169908432 None] Created volume successfully. Jul 11 18:50:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-8fbc4eda-2535-46ac-b58c-862792bc8f4d-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Lock "cinder-8fbc4eda-2535-46ac-b58c-862792bc8f4d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-quobyte-8fbc4eda-2535-46ac-b58c-862792bc8f4d" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-8fbc4eda-2535-46ac-b58c-862792bc8f4d" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:54 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1145cf4-23c6-45c6-b4c7-3ded807303b2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:54 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d Jul 11 18:50:54 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:55 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d" returned: 0 in 1.090s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:55 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d Jul 11 18:50:55 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:56 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8fbc4eda-2535-46ac-b58c-862792bc8f4d" returned: 0 in 0.977s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-8fbc4eda-2535-46ac-b58c-862792bc8f4d" released by "delete_volume" :: held 2.140s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:56 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Created reservations ['7ae7f8b8-75b5-4e74-8e1c-9749999a2aa8', '9b35b846-dc1c-4333-a268-d6fb4c4d37cf', 'c95895e0-b9b7-4c27-9c87-9e05bb43674c', '3ff3d06c-1a8c-4c95-814d-ecd518bd54f5'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:50:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:50:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:50:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:50:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:50:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:50:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:56 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:50:56 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:57 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.761s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:57 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:50:57 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Deleted volume successfully. Jul 11 18:50:57 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62906ed9-037d-4191-b220-da8c8921a10f tempest-VolumesGetTest-1169908432 None] Lock "cinder-8fbc4eda-2535-46ac-b58c-862792bc8f4d-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:50:57 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-795a6a67-da4b-4b74-a0b4-0e701a428bdb-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Lock "cinder-795a6a67-da4b-4b74-a0b4-0e701a428bdb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Acquiring lock "cinder-quobyte-795a6a67-da4b-4b74-a0b4-0e701a428bdb" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:50:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-795a6a67-da4b-4b74-a0b4-0e701a428bdb" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:50:58 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfea271e-8efb-44f2-aaa5-c776e6687cc5]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:50:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:58 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb Jul 11 18:50:58 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:50:59 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 11 18:50:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb" returned: 0 in 0.919s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:50:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:50:59 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb Jul 11 18:50:59 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:00 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb" returned: 1 in 0.954s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:51:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:00 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb Jul 11 18:51:00 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:01 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-795a6a67-da4b-4b74-a0b4-0e701a428bdb" returned: 0 in 0.912s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Lock "cinder-quobyte-795a6a67-da4b-4b74-a0b4-0e701a428bdb" released by "delete_volume" :: held 2.889s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:01 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Created reservations ['5029b868-cac8-4e09-99e6-3930756e767d', '3d33b6ee-436c-40b0-b63f-4f97b4fb1243', '912a698a-5795-412d-8124-f58fb344f254', '14505856-bb31-4fa8-9ba0-567c9ce5c969'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:51:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:01 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:51:01 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:02 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.028s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:02 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:02 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Deleted volume successfully. Jul 11 18:51:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-caa14f2b-8fbe-4ee0-90cb-b9428e0f7bfe tempest-VolumesGetTest-1169908432 None] Lock "cinder-795a6a67-da4b-4b74-a0b4-0e701a428bdb-delete_volume" released by "delete_volume" :: held 4.230s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Flow 'volume_create_manager' (69ff4aba-7a2c-4a06-8cc8-cf44acc0cc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75464084-8af7-463f-9283-ede7677cee6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75464084-8af7-463f-9283-ede7677cee6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1510499556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0736d153-9495-4a7e-b4b4-69adbee2e6e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6555ef1cf74a2e83776b2394a34bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:04Z,use_quota=True,user_id='4102c449718b4f1899d52ddef916216c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2df9a4-c9e0-4c5e-be17-dbe92cf51de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2df9a4-c9e0-4c5e-be17-dbe92cf51de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0cd26b-264a-45ef-8df1-8fcdc2c80029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0cd26b-264a-45ef-8df1-8fcdc2c80029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0736d153-9495-4a7e-b4b4-69adbee2e6e4', 'volume_name': 'volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6195391b-5aaa-402d-b6a6-1b95ffb90593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6195391b-5aaa-402d-b6a6-1b95ffb90593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2431ea58-76c9-44f8-87a8-7a646faa59aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:04 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Volume 0736d153-9495-4a7e-b4b4-69adbee2e6e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4', 'volume_size': 1} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1510499556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0736d153-9495-4a7e-b4b4-69adbee2e6e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6555ef1cf74a2e83776b2394a34bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:04Z,use_quota=True,user_id='4102c449718b4f1899d52ddef916216c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Creating volume 0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:04 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:51:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:04 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 1073741824 Jul 11 18:51:04 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:05 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 1073741824" returned: 0 in 1.362s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:06 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 Jul 11 18:51:06 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:07 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4" returned: 0 in 1.166s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] <== create_volume: return (2650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.654s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2431ea58-76c9-44f8-87a8-7a646faa59aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d154a19-11ae-4d00-bebc-2649264abf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:07 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Volume volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 (0736d153-9495-4a7e-b4b4-69adbee2e6e4): created successfully Jul 11 18:51:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d154a19-11ae-4d00-bebc-2649264abf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Flow 'volume_create_manager' (69ff4aba-7a2c-4a06-8cc8-cf44acc0cc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e20062a9-97da-4402-ac0d-33569e5b02d1 tempest-TestStampPattern-1263975939 None] Created volume successfully. Jul 11 18:51:17 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=67,cinder:DELETE=4,cinder:SELECT=59,cinder:INSERT=18 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:51:17 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=49,cinder:INSERT=28,cinder:UPDATE=76,cinder:DELETE=9 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:51:32 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-127b3195-24f0-4d3e-b56a-8d3407d440ee req-226732ed-7a63-492d-bfbe-7632b1f91c01 tempest-TestMinimumBasicScenario-2012652068 None] Terminate volume connection completed successfully. Jul 11 18:51:32 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-127b3195-24f0-4d3e-b56a-8d3407d440ee req-226732ed-7a63-492d-bfbe-7632b1f91c01 tempest-TestMinimumBasicScenario-2012652068 None] Deleting attachment e3e0d265-a46f-4c9a-9969-c4f7dd3de2dc. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:51:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Acquiring lock "cinder-cfc696ad-c450-4e26-a8b6-4879e1119c01-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Lock "cinder-cfc696ad-c450-4e26-a8b6-4879e1119c01-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Acquiring lock "cinder-quobyte-cfc696ad-c450-4e26-a8b6-4879e1119c01" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:51:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Lock "cinder-quobyte-cfc696ad-c450-4e26-a8b6-4879e1119c01" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:51:35 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe7afd6-1e06-49e4-b644-9232a828ba1d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:35 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 Jul 11 18:51:35 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:36 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01" returned: 0 in 0.893s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:36 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01 Jul 11 18:51:36 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:37 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cfc696ad-c450-4e26-a8b6-4879e1119c01" returned: 0 in 0.882s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Lock "cinder-quobyte-cfc696ad-c450-4e26-a8b6-4879e1119c01" released by "delete_volume" :: held 1.844s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Created reservations ['2e0896c1-f38f-46c5-b167-6ec7b935b9e5', 'f0778916-0439-496e-b0b1-ce8ffb3e5630', '14251df4-55c3-4a24-a9a4-12a347ec930b', 'daceabd5-2f97-4d67-b978-871efc47c727'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Flow 'volume_create_manager' (78c63530-1405-460a-910b-99c0f83d8344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a390846d-5735-4622-bcc2-a409de867642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a390846d-5735-4622-bcc2-a409de867642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-554815377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75196484-3f29-44f6-8bc0-fc65d4e283a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a99db8fe1f8466f95c4981eb697dc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:37Z,use_quota=True,user_id='92251b5f8db3407eb1fb79b46341c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c8a52c-cee8-4f43-baab-c0a1d4e4e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c8a52c-cee8-4f43-baab-c0a1d4e4e291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22b6b7b-b431-448a-a717-98fb5bd9c732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22b6b7b-b431-448a-a717-98fb5bd9c732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75196484-3f29-44f6-8bc0-fc65d4e283a1', 'volume_name': 'volume-75196484-3f29-44f6-8bc0-fc65d4e283a1', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8882972-d2b8-4021-b08c-9a7bbe4dee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8882972-d2b8-4021-b08c-9a7bbe4dee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4254df-d632-4a98-8159-67ca8d9e7ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:37 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Volume 75196484-3f29-44f6-8bc0-fc65d4e283a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75196484-3f29-44f6-8bc0-fc65d4e283a1', 'volume_size': 1} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-554815377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75196484-3f29-44f6-8bc0-fc65d4e283a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a99db8fe1f8466f95c4981eb697dc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:37Z,use_quota=True,user_id='92251b5f8db3407eb1fb79b46341c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Creating volume 75196484-3f29-44f6-8bc0-fc65d4e283a1 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:37 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:37 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 1073741824 Jul 11 18:51:37 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:37 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:51:37 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:38 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.135s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:38 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Deleted volume successfully. Jul 11 18:51:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1b74725b-31fc-4735-a182-401a44c07ef5 tempest-TestMinimumBasicScenario-2012652068 None] Lock "cinder-cfc696ad-c450-4e26-a8b6-4879e1119c01-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:51:38 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 1073741824" returned: 0 in 1.300s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:38 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 Jul 11 18:51:38 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:39 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1" returned: 0 in 0.825s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4254df-d632-4a98-8159-67ca8d9e7ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75196484-3f29-44f6-8bc0-fc65d4e283a1', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4957d9d6-f204-4271-9eb4-fb787ada3a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:39 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Volume volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 (75196484-3f29-44f6-8bc0-fc65d4e283a1): created successfully Jul 11 18:51:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4957d9d6-f204-4271-9eb4-fb787ada3a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Flow 'volume_create_manager' (78c63530-1405-460a-910b-99c0f83d8344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:39 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-058f2d4e-3007-4acb-87c4-9f287cd758fe tempest-AttachVolumeNegativeTest-1126116839 None] Created volume successfully. Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Flow 'volume_create_manager' (19357164-0169-4587-95e0-10e233430d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f41abf-a207-4418-88e7-3523bf8ff46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f41abf-a207-4418-88e7-3523bf8ff46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-12975316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a5589b-929e-4b72-bd5c-726ddfc98ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5730d80780214fce9d9a6467da294c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:40Z,use_quota=True,user_id='ba462b8bdeca4c96895d6f685b602260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(312f3ddf-7073-4d52-bf9f-569c789ceaa5),volume_type_id=312f3ddf-7073-4d52-bf9f-569c789ceaa5)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54d72d7-bbc2-473e-8c2f-ea9ec860d8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54d72d7-bbc2-473e-8c2f-ea9ec860d8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f5d7a9-a561-4bdf-856d-44a5b5f3233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f5d7a9-a561-4bdf-856d-44a5b5f3233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a5589b-929e-4b72-bd5c-726ddfc98ade', 'volume_name': 'volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc056b9d-ffc0-4cb3-bbad-24965647749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc056b9d-ffc0-4cb3-bbad-24965647749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a60dc60-cfc7-43ce-a21a-8cd59ff02796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:40 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Volume d2a5589b-929e-4b72-bd5c-726ddfc98ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade', 'volume_size': 1} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-12975316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a5589b-929e-4b72-bd5c-726ddfc98ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5730d80780214fce9d9a6467da294c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:40Z,use_quota=True,user_id='ba462b8bdeca4c96895d6f685b602260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(312f3ddf-7073-4d52-bf9f-569c789ceaa5),volume_type_id=312f3ddf-7073-4d52-bf9f-569c789ceaa5)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Creating volume d2a5589b-929e-4b72-bd5c-726ddfc98ade {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:40 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:40 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade 1073741824 Jul 11 18:51:40 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Flow 'volume_create_manager' (a5841c9f-1c9f-4967-8b0d-58f56249c6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a0c584-b0cc-4361-9df0-2e3e3b61b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a0c584-b0cc-4361-9df0-2e3e3b61b823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1612438357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6d908c-e333-4fd8-b3ae-b68ec4c6c476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5730d80780214fce9d9a6467da294c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:41Z,use_quota=True,user_id='ba462b8bdeca4c96895d6f685b602260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00478e2f-ea21-4a39-80a2-b3f109051e02),volume_type_id=00478e2f-ea21-4a39-80a2-b3f109051e02)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1ad808-cc3d-471c-8692-bc88731e55ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1ad808-cc3d-471c-8692-bc88731e55ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd39bf76-8868-4171-86ce-71e8a8098c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd39bf76-8868-4171-86ce-71e8a8098c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6d908c-e333-4fd8-b3ae-b68ec4c6c476', 'volume_name': 'volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea5602e-7e76-49db-81ec-bb6bd6fd4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea5602e-7e76-49db-81ec-bb6bd6fd4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcccabec-1689-4a7d-8f5b-e636c67742c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:40 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Volume ed6d908c-e333-4fd8-b3ae-b68ec4c6c476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476', 'volume_size': 1} Jul 11 18:51:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:41 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade 1073741824" returned: 0 in 1.224s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Flow 'volume_create_manager' (de68d95f-9270-4467-996e-15e0e520c3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5226bab9-ae95-489c-8a40-50a9d0cabcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5226bab9-ae95-489c-8a40-50a9d0cabcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1094750795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dc6fc0-852f-48ea-b740-7984b3b7bcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5730d80780214fce9d9a6467da294c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:41Z,use_quota=True,user_id='ba462b8bdeca4c96895d6f685b602260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8133c495-441a-4104-946b-b170c2c91a0a),volume_type_id=8133c495-441a-4104-946b-b170c2c91a0a)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9770fc54-ad94-497e-8ce5-534d17b0cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9770fc54-ad94-497e-8ce5-534d17b0cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0caed759-8077-4ea5-a418-b53d45e5fef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.image.glance [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Creating Keystone auth plugin from conf {{(pid=87411) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:41 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade Jul 11 18:51:41 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0caed759-8077-4ea5-a418-b53d45e5fef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23dc6fc0-852f-48ea-b740-7984b3b7bcfc', 'volume_name': 'volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc', 'volume_size': 1, 'image_id': '3a450676-5907-4f4a-b507-8514ce811759', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a450676-5907-4f4a-b507-8514ce811759', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2018778148', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5730d80780214fce9d9a6467da294c19', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a450676-5907-4f4a-b507-8514ce811759', 'created_at': datetime.datetime(2026, 7, 11, 16, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 51, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a450676-5907-4f4a-b507-8514ce811759/file', 'properties': {}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7070e89d-e4f5-4aa4-9d76-9637c4f96766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7070e89d-e4f5-4aa4-9d76-9637c4f96766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1bedc1-03d9-4b8f-b0cf-3719dfdc0f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:41 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Volume 23dc6fc0-852f-48ea-b740-7984b3b7bcfc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc', 'volume_size': 1, 'image_id': '3a450676-5907-4f4a-b507-8514ce811759', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a450676-5907-4f4a-b507-8514ce811759', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2018778148', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5730d80780214fce9d9a6467da294c19', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a450676-5907-4f4a-b507-8514ce811759', 'created_at': datetime.datetime(2026, 7, 11, 16, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 51, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a450676-5907-4f4a-b507-8514ce811759/file', 'properties': {}}, 'image_service': } Jul 11 18:51:41 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Trying to clone 23dc6fc0-852f-48ea-b740-7984b3b7bcfc from image 3a450676-5907-4f4a-b507-8514ce811759 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a450676-5907-4f4a-b507-8514ce811759', 'metadata': {}}]). {{(pid=87411) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:51:42 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade" returned: 0 in 0.713s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1612438357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6d908c-e333-4fd8-b3ae-b68ec4c6c476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5730d80780214fce9d9a6467da294c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:41Z,use_quota=True,user_id='ba462b8bdeca4c96895d6f685b602260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00478e2f-ea21-4a39-80a2-b3f109051e02),volume_type_id=00478e2f-ea21-4a39-80a2-b3f109051e02)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Creating volume ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:42 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a60dc60-cfc7-43ce-a21a-8cd59ff02796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:42 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 1073741824 Jul 11 18:51:42 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e9a92e-d7f8-4dd6-aa87-4497e7fd8332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:42 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Volume volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade (d2a5589b-929e-4b72-bd5c-726ddfc98ade): created successfully Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e9a92e-d7f8-4dd6-aa87-4497e7fd8332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Flow 'volume_create_manager' (19357164-0169-4587-95e0-10e233430d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:42 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-816d6a44-e4c6-436b-985e-d1b9e8dc883e tempest-TestInstancesWithCinderVolumes-1309651517 None] Created volume successfully. Jul 11 18:51:43 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 1073741824" returned: 0 in 0.895s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:43 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 Jul 11 18:51:43 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-d4dc7a22-115e-42cd-b8bc-9381fdcfa315 req-e23427cc-302f-4cc6-b5c5-262cc923f578 tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:43 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476" returned: 0 in 0.666s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-d4dc7a22-115e-42cd-b8bc-9381fdcfa315 req-e23427cc-302f-4cc6-b5c5-262cc923f578 tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.213s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcccabec-1689-4a7d-8f5b-e636c67742c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e0fb73-a05b-4f12-a8ae-16ad41d530f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d92b3e-c2e2-476e-bf0c-b8f4c8b83829]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-d4dc7a22-115e-42cd-b8bc-9381fdcfa315 req-e23427cc-302f-4cc6-b5c5-262cc923f578 tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:44 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Volume volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 (ed6d908c-e333-4fd8-b3ae-b68ec4c6c476): created successfully Jul 11 18:51:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e0fb73-a05b-4f12-a8ae-16ad41d530f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Flow 'volume_create_manager' (a5841c9f-1c9f-4967-8b0d-58f56249c6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-768c125f-ec8f-42ff-95c9-9d151a999bc0 tempest-TestInstancesWithCinderVolumes-1309651517 None] Created volume successfully. Jul 11 18:51:44 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 Jul 11 18:51:44 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:44 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-d4dc7a22-115e-42cd-b8bc-9381fdcfa315 req-e23427cc-302f-4cc6-b5c5-262cc923f578 tempest-AttachVolumeNegativeTest-1126116839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1" returned: 0 in 0.809s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-d4dc7a22-115e-42cd-b8bc-9381fdcfa315 req-e23427cc-302f-4cc6-b5c5-262cc923f578 tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.844s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-d4dc7a22-115e-42cd-b8bc-9381fdcfa315 req-e23427cc-302f-4cc6-b5c5-262cc923f578 tempest-AttachVolumeNegativeTest-1126116839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-75196484-3f29-44f6-8bc0-fc65d4e283a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24a3bdb4-e43a-4507-aa1d-4c9851291d5a', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:51:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-d4dc7a22-115e-42cd-b8bc-9381fdcfa315 req-e23427cc-302f-4cc6-b5c5-262cc923f578 tempest-AttachVolumeNegativeTest-1126116839 None] attachment_update completed successfully. Jul 11 18:51:45 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD, size 20.69 MB, duration 3.65 sec {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:51:45 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Image download 20.69 MB at 5.67 MB/s Jul 11 18:51:45 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfad433-3bc2-4292-9045-e57ff7c47c24]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:45 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD Jul 11 18:51:45 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:46 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD" returned: 0 in 0.973s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:46 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Temporary image 3a450676-5907-4f4a-b507-8514ce811759 is fetched for user ba462b8bdeca4c96895d6f685b602260. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:51:46 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e462b9-a64e-4c8c-8fb8-c93b124f6bc7]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:46 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD Jul 11 18:51:46 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:47 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD" returned: 0 in 0.794s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1094750795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23dc6fc0-852f-48ea-b740-7984b3b7bcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5730d80780214fce9d9a6467da294c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:51:41Z,use_quota=True,user_id='ba462b8bdeca4c96895d6f685b602260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8133c495-441a-4104-946b-b170c2c91a0a),volume_type_id=8133c495-441a-4104-946b-b170c2c91a0a)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Creating volume 23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:51:47 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:51:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:47 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc 1073741824 Jul 11 18:51:47 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:48 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc 1073741824" returned: 0 in 0.941s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:48 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc Jul 11 18:51:48 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:49 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" returned: 0 in 0.786s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:49 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:51:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:49 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Attempting download of 3a450676-5907-4f4a-b507-8514ce811759 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a450676-5907-4f4a-b507-8514ce811759', 'metadata': {}}])) to volume 23dc6fc0-852f-48ea-b740-7984b3b7bcfc. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:51:49 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9d1042-de17-400a-9c6f-b5a040c7b66c]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a450676-5907-4f4a-b507-8514ce811759_cuw_ss4n {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:49 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a450676-5907-4f4a-b507-8514ce811759_cuw_ss4n Jul 11 18:51:49 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:50 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a450676-5907-4f4a-b507-8514ce811759_cuw_ss4n" returned: 0 in 0.893s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a450676-5907-4f4a-b507-8514ce811759_cuw_ss4n {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:50 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a450676-5907-4f4a-b507-8514ce811759_cuw_ss4n Jul 11 18:51:50 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:51 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a450676-5907-4f4a-b507-8514ce811759_cuw_ss4n" returned: 1 in 0.814s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a450676-5907-4f4a-b507-8514ce811759_cuw_ss4n' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cf8ce5-4c9d-4512-9fbe-e18cf514808c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:51 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD Jul 11 18:51:51 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:51 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:51:51 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:52 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD" returned: 0 in 0.938s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] 3a450676-5907-4f4a-b507-8514ce811759 was qcow2, converting to raw {{(pid=87411) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:52 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc Jul 11 18:51:52 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:52 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.954s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-3a8ca52c-b099-4425-bc65-1b5c4f77fe19 req-4f982934-dad9-4659-95be-f66d420dff32 tempest-TestStampPattern-1263975939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-3a8ca52c-b099-4425-bc65-1b5c4f77fe19 req-4f982934-dad9-4659-95be-f66d420dff32 tempest-TestStampPattern-1263975939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9254fc-53ca-4f10-add2-cf9971169f18]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-3a8ca52c-b099-4425-bc65-1b5c4f77fe19 req-4f982934-dad9-4659-95be-f66d420dff32 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:52 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 Jul 11 18:51:52 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:53 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-3a8ca52c-b099-4425-bc65-1b5c4f77fe19 req-4f982934-dad9-4659-95be-f66d420dff32 tempest-TestStampPattern-1263975939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4" returned: 0 in 1.143s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-3a8ca52c-b099-4425-bc65-1b5c4f77fe19 req-4f982934-dad9-4659-95be-f66d420dff32 tempest-TestStampPattern-1263975939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.169s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:51:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-3a8ca52c-b099-4425-bc65-1b5c4f77fe19 req-4f982934-dad9-4659-95be-f66d420dff32 tempest-TestStampPattern-1263975939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2040e43c-592b-4017-bd96-413bd7be9763', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:51:53 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-3a8ca52c-b099-4425-bc65-1b5c4f77fe19 req-4f982934-dad9-4659-95be-f66d420dff32 tempest-TestStampPattern-1263975939 None] attachment_update completed successfully. Jul 11 18:51:54 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" returned: 0 in 2.748s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:54 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a450676-5907-4f4a-b507-8514ce811759_fq_l6sjmdevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:51:54 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Converted 112.00 MB image at 40.75 MB/s Jul 11 18:51:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:54 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc 1G Jul 11 18:51:54 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:55 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc 1G" returned: 0 in 0.846s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:55 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[12072fa1-7759-4890-8b41-3c8ec58e87f0]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:51:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:55 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc Jul 11 18:51:55 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:56 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" returned: 0 in 0.837s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:51:56 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc Jul 11 18:51:56 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:51:57 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" returned: 1 in 0.817s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Downloaded image 3a450676-5907-4f4a-b507-8514ce811759 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a450676-5907-4f4a-b507-8514ce811759', 'metadata': {}}])) to volume 23dc6fc0-852f-48ea-b740-7984b3b7bcfc successfully. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Temporary image 3a450676-5907-4f4a-b507-8514ce811759 for user ba462b8bdeca4c96895d6f685b602260 is deleted. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Marking volume 23dc6fc0-852f-48ea-b740-7984b3b7bcfc as bootable. {{(pid=87411) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Copying metadata from image 3a450676-5907-4f4a-b507-8514ce811759 to 23dc6fc0-852f-48ea-b740-7984b3b7bcfc. {{(pid=87411) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Creating volume glance metadata for volume 23dc6fc0-852f-48ea-b740-7984b3b7bcfc backed by image 3a450676-5907-4f4a-b507-8514ce811759 with: {'image_id': '3a450676-5907-4f4a-b507-8514ce811759', 'image_name': 'tempest-scenario-img--2018778148', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87411) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1bedc1-03d9-4b8f-b0cf-3719dfdc0f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc', 'volume_size': 1, 'image_id': '3a450676-5907-4f4a-b507-8514ce811759', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a450676-5907-4f4a-b507-8514ce811759', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2018778148', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5730d80780214fce9d9a6467da294c19', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a450676-5907-4f4a-b507-8514ce811759', 'created_at': datetime.datetime(2026, 7, 11, 16, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 51, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a450676-5907-4f4a-b507-8514ce811759/file', 'properties': {}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0daf5c61-4f53-40ad-889a-9e8be5089b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:51:57 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Volume volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc (23dc6fc0-852f-48ea-b740-7984b3b7bcfc): created successfully Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0daf5c61-4f53-40ad-889a-9e8be5089b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:51:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Flow 'volume_create_manager' (de68d95f-9270-4467-996e-15e0e520c3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:51:57 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5a23eaf7-a328-498c-8b25-ca02ac8970f1 tempest-TestInstancesWithCinderVolumes-1309651517 None] Created volume successfully. Jul 11 18:52:03 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-9ea365ed-3c63-437c-a44a-783445faa656 req-7ed38c76-f467-4f51-98ec-4443782252e7 tempest-TestStampPattern-1263975939 None] Terminate volume connection completed successfully. Jul 11 18:52:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-9ea365ed-3c63-437c-a44a-783445faa656 req-7ed38c76-f467-4f51-98ec-4443782252e7 tempest-TestStampPattern-1263975939 None] Deleting attachment 2040e43c-592b-4017-bd96-413bd7be9763. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:52:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Creating offline snapshot 80f378de-7ec8-4a85-9ba8-5c92f6b9a51c of volume 0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:52:05 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[630983f1-f823-4eba-90da-91484911bbbf]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:05 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 Jul 11 18:52:05 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-6ae665b4-019d-47a0-8aab-6b04970f380f req-ef2ad206-b1cd-4fae-b04b-68f973f00d33 tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:06 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4" returned: 0 in 1.065s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:06 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c 1G Jul 11 18:52:06 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:07 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c 1G" returned: 0 in 0.966s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:07 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c Jul 11 18:52:07 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:08 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c" returned: 0 in 0.804s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:08 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c is being set with open permissions: ugo+rw Jul 11 18:52:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:08 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c Jul 11 18:52:08 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:09 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c" returned: 0 in 0.810s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:09 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.info Jul 11 18:52:09 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:10 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.info" returned: 0 in 0.834s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:10 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.info is being set with open permissions: ugo+rw Jul 11 18:52:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:10 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.info Jul 11 18:52:10 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:10 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.info" returned: 0 in 0.735s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.355s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-6ae665b4-019d-47a0-8aab-6b04970f380f req-ef2ad206-b1cd-4fae-b04b-68f973f00d33 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.814s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:11 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d1f56cee-0abe-4929-84a0-bb5db50a739e tempest-TestStampPattern-1263975939 None] Create snapshot completed successfully Jul 11 18:52:11 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cece7a-3729-43fe-81c3-406974b12991]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-6ae665b4-019d-47a0-8aab-6b04970f380f req-ef2ad206-b1cd-4fae-b04b-68f973f00d33 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:11 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc Jul 11 18:52:11 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:11 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-6ae665b4-019d-47a0-8aab-6b04970f380f req-ef2ad206-b1cd-4fae-b04b-68f973f00d33 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" returned: 0 in 0.743s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-6ae665b4-019d-47a0-8aab-6b04970f380f req-ef2ad206-b1cd-4fae-b04b-68f973f00d33 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:11 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc Jul 11 18:52:11 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:12 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-6ae665b4-019d-47a0-8aab-6b04970f380f req-ef2ad206-b1cd-4fae-b04b-68f973f00d33 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" returned: 1 in 0.815s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-6ae665b4-019d-47a0-8aab-6b04970f380f req-ef2ad206-b1cd-4fae-b04b-68f973f00d33 tempest-TestInstancesWithCinderVolumes-1309651517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:52:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-6ae665b4-019d-47a0-8aab-6b04970f380f req-ef2ad206-b1cd-4fae-b04b-68f973f00d33 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.610s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-6ae665b4-019d-47a0-8aab-6b04970f380f req-ef2ad206-b1cd-4fae-b04b-68f973f00d33 tempest-TestInstancesWithCinderVolumes-1309651517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '806707b2-12bd-4edf-9f63-1ba0cf937df5', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:52:12 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-6ae665b4-019d-47a0-8aab-6b04970f380f req-ef2ad206-b1cd-4fae-b04b-68f973f00d33 tempest-TestInstancesWithCinderVolumes-1309651517 None] attachment_update completed successfully. Jul 11 18:52:22 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=40,cinder:INSERT=8,cinder:UPDATE=28,cinder:DELETE=4 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:52:22 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=42,cinder:UPDATE=28,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Flow 'volume_create_manager' (3e498407-0fbb-4a72-90ab-d54bf9707a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16604f8-c13a-4209-a200-90e7f0784e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16604f8-c13a-4209-a200-90e7f0784e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-819478977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67585e43-f651-4041-b1fb-0e545a90a17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6555ef1cf74a2e83776b2394a34bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=80f378de-7ec8-4a85-9ba8-5c92f6b9a51c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:52:23Z,use_quota=True,user_id='4102c449718b4f1899d52ddef916216c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b5d150-8659-4477-8c43-dc10aace158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b5d150-8659-4477-8c43-dc10aace158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf1ff3f-3ebb-49dd-9ea5-72ecb3922127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf1ff3f-3ebb-49dd-9ea5-72ecb3922127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67585e43-f651-4041-b1fb-0e545a90a17c', 'volume_name': 'volume-67585e43-f651-4041-b1fb-0e545a90a17c', 'volume_size': 1, 'snapshot_id': '80f378de-7ec8-4a85-9ba8-5c92f6b9a51c'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884125b8-0d8e-4f04-83db-edcda2ea9994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884125b8-0d8e-4f04-83db-edcda2ea9994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbea9e0-6771-4fcb-9758-2e06daf2c724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:23 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Volume 67585e43-f651-4041-b1fb-0e545a90a17c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67585e43-f651-4041-b1fb-0e545a90a17c', 'volume_size': 1, 'snapshot_id': '80f378de-7ec8-4a85-9ba8-5c92f6b9a51c'} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Acquiring lock "cinder-quobyte-80f378de-7ec8-4a85-9ba8-5c92f6b9a51c-67585e43-f651-4041-b1fb-0e545a90a17c" by "_create_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-80f378de-7ec8-4a85-9ba8-5c92f6b9a51c-67585e43-f651-4041-b1fb-0e545a90a17c" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Creating volume 67585e43-f651-4041-b1fb-0e545a90a17c from snapshot 80f378de-7ec8-4a85-9ba8-5c92f6b9a51c {{(pid=87411) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Acquiring lock "cinder-quobyte-67585e43-f651-4041-b1fb-0e545a90a17c" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-67585e43-f651-4041-b1fb-0e545a90a17c" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] snapshot: 80f378de-7ec8-4a85-9ba8-5c92f6b9a51c, volume: 67585e43-f651-4041-b1fb-0e545a90a17c, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3652ed4-6ea0-48b9-8542-97831ea00900]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:23 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c Jul 11 18:52:23 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:24 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c" returned: 0 in 1.119s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:52:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:52:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:52:24 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a85b1f-48ee-46fa-81eb-4bee3672fe42]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:24 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 Jul 11 18:52:24 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:26 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4" returned: 0 in 1.494s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:26 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:52:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:26 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c Jul 11 18:52:26 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:33 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=2 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:52:33 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:52:34 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c" returned: 0 in 8.493s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:34 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac34819c-8276-47ae-9ee4-cffc831c3ab2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:34 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 Jul 11 18:52:34 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:36 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4" returned: 0 in 2.002s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:36 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4, size 1024.00 MB, duration 8.49 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:52:36 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Converted 1024.00 MB image at 120.55 MB/s Jul 11 18:52:36 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c is being set with open permissions: ugo+rw Jul 11 18:52:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:36 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c Jul 11 18:52:36 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:37 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c" returned: 0 in 0.931s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-67585e43-f651-4041-b1fb-0e545a90a17c" released by "_copy_volume_from_snapshot" :: held 14.192s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-80f378de-7ec8-4a85-9ba8-5c92f6b9a51c-67585e43-f651-4041-b1fb-0e545a90a17c" released by "_create_volume_from_snapshot" :: held 14.246s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:52:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.278s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbea9e0-6771-4fcb-9758-2e06daf2c724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67585e43-f651-4041-b1fb-0e545a90a17c', 'volume_size': 1, 'snapshot_id': '80f378de-7ec8-4a85-9ba8-5c92f6b9a51c'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fea4ef1-8858-4f07-9f1d-b35f413489b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:52:37 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Volume volume-67585e43-f651-4041-b1fb-0e545a90a17c (67585e43-f651-4041-b1fb-0e545a90a17c): created successfully Jul 11 18:52:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fea4ef1-8858-4f07-9f1d-b35f413489b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:52:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Flow 'volume_create_manager' (3e498407-0fbb-4a72-90ab-d54bf9707a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:52:37 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9ad8ed25-d7ad-4e2f-aadf-681cca749723 tempest-TestStampPattern-1263975939 None] Created volume successfully. Jul 11 18:52:42 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-05191296-187b-4e90-9736-f5fe28e1a632 req-92e4999e-9902-4915-93e4-85bca8bb1aa6 tempest-AttachVolumeNegativeTest-1126116839 None] Terminate volume connection completed successfully. Jul 11 18:52:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-05191296-187b-4e90-9736-f5fe28e1a632 req-92e4999e-9902-4915-93e4-85bca8bb1aa6 tempest-AttachVolumeNegativeTest-1126116839 None] Deleting attachment 24a3bdb4-e43a-4507-aa1d-4c9851291d5a. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:52:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-532a3b9f-21f9-4e31-abc8-31fea00e676a req-18717370-283a-4520-b116-6dfdf7b284b4 tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-532a3b9f-21f9-4e31-abc8-31fea00e676a req-18717370-283a-4520-b116-6dfdf7b284b4 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:50 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb0fba-f137-4c04-8cb4-30ebb37ce97e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-532a3b9f-21f9-4e31-abc8-31fea00e676a req-18717370-283a-4520-b116-6dfdf7b284b4 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:50 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade Jul 11 18:52:50 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:51 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-532a3b9f-21f9-4e31-abc8-31fea00e676a req-18717370-283a-4520-b116-6dfdf7b284b4 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade" returned: 0 in 0.879s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-532a3b9f-21f9-4e31-abc8-31fea00e676a req-18717370-283a-4520-b116-6dfdf7b284b4 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.909s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-532a3b9f-21f9-4e31-abc8-31fea00e676a req-18717370-283a-4520-b116-6dfdf7b284b4 tempest-TestInstancesWithCinderVolumes-1309651517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '443afc43-92c2-4385-9845-0f744180c940', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:52:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:52:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:52:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:52:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:52:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:52:51 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:52:51 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:52:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-532a3b9f-21f9-4e31-abc8-31fea00e676a req-18717370-283a-4520-b116-6dfdf7b284b4 tempest-TestInstancesWithCinderVolumes-1309651517 None] attachment_update completed successfully. Jul 11 18:52:52 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Jul 11 18:52:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.696s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:52:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:52:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:52:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:52:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:52:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-004b3e0a-6c05-45b3-9bec-5412a10c5cc5 req-9cae8d22-887f-4e73-b414-99deba45bf0d tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:52:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-004b3e0a-6c05-45b3-9bec-5412a10c5cc5 req-9cae8d22-887f-4e73-b414-99deba45bf0d tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:52:59 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37d969f-3af7-4777-9cdd-64e3303c7f86]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:52:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-004b3e0a-6c05-45b3-9bec-5412a10c5cc5 req-9cae8d22-887f-4e73-b414-99deba45bf0d tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:00 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 Jul 11 18:53:00 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:00 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-004b3e0a-6c05-45b3-9bec-5412a10c5cc5 req-9cae8d22-887f-4e73-b414-99deba45bf0d tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476" returned: 0 in 0.732s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-004b3e0a-6c05-45b3-9bec-5412a10c5cc5 req-9cae8d22-887f-4e73-b414-99deba45bf0d tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.746s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-004b3e0a-6c05-45b3-9bec-5412a10c5cc5 req-9cae8d22-887f-4e73-b414-99deba45bf0d tempest-TestInstancesWithCinderVolumes-1309651517 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca7fc2c0-a983-4735-bce8-232ac21cfedf', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:53:00 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-004b3e0a-6c05-45b3-9bec-5412a10c5cc5 req-9cae8d22-887f-4e73-b414-99deba45bf0d tempest-TestInstancesWithCinderVolumes-1309651517 None] attachment_update completed successfully. Jul 11 18:53:09 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-0b5a67b7-da53-4730-941c-5ad4cabd1960 req-dd57828f-55d2-46c2-a110-b901cc0533d2 tempest-TestInstancesWithCinderVolumes-1309651517 None] Terminate volume connection completed successfully. Jul 11 18:53:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-0b5a67b7-da53-4730-941c-5ad4cabd1960 req-dd57828f-55d2-46c2-a110-b901cc0533d2 tempest-TestInstancesWithCinderVolumes-1309651517 None] Deleting attachment 443afc43-92c2-4385-9845-0f744180c940. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:53:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "cinder-d2a5589b-929e-4b72-bd5c-726ddfc98ade-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-d2a5589b-929e-4b72-bd5c-726ddfc98ade-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "cinder-quobyte-d2a5589b-929e-4b72-bd5c-726ddfc98ade" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-quobyte-d2a5589b-929e-4b72-bd5c-726ddfc98ade" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfb10d2-14ce-4c28-b3e9-0583f2f02721]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:12 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade Jul 11 18:53:12 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:13 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade" returned: 0 in 0.969s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:13 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade Jul 11 18:53:13 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:13 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d2a5589b-929e-4b72-bd5c-726ddfc98ade" returned: 0 in 0.926s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-quobyte-d2a5589b-929e-4b72-bd5c-726ddfc98ade" released by "delete_volume" :: held 1.963s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:14 devstack cinder-volume[87411]: WARNING cinder.quota [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-987474282-1497236621 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-987474282-1497236621, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:53:14 devstack cinder-volume[87411]: WARNING cinder.quota [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-987474282-1497236621 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-987474282-1497236621, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-3c2881b6-149e-440a-8da7-5ece9ac52530 req-8875c527-0d4f-42a1-b038-cbf4f46a92cd tempest-TestStampPattern-1263975939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-3c2881b6-149e-440a-8da7-5ece9ac52530 req-8875c527-0d4f-42a1-b038-cbf4f46a92cd tempest-TestStampPattern-1263975939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Created reservations ['3edbd015-4d90-4e4a-b063-436c5655a3ac', '622d6484-eb2d-427d-805a-613cb3d90596', 'ffff5c13-af23-414e-9b19-c447c43ba2b6', 'ae7c62d2-cc7c-41fb-993d-613137dccb1c'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1592991e-b638-42b0-b53e-ffea190f9c14]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-3c2881b6-149e-440a-8da7-5ece9ac52530 req-8875c527-0d4f-42a1-b038-cbf4f46a92cd tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:14 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c Jul 11 18:53:14 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:14 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:53:14 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:15 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-3c2881b6-149e-440a-8da7-5ece9ac52530 req-8875c527-0d4f-42a1-b038-cbf4f46a92cd tempest-TestStampPattern-1263975939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c" returned: 0 in 1.145s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-3c2881b6-149e-440a-8da7-5ece9ac52530 req-8875c527-0d4f-42a1-b038-cbf4f46a92cd tempest-TestStampPattern-1263975939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.186s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-3c2881b6-149e-440a-8da7-5ece9ac52530 req-8875c527-0d4f-42a1-b038-cbf4f46a92cd tempest-TestStampPattern-1263975939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-67585e43-f651-4041-b1fb-0e545a90a17c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4bee4ed-9f25-466a-a441-b904540df929', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:53:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-3c2881b6-149e-440a-8da7-5ece9ac52530 req-8875c527-0d4f-42a1-b038-cbf4f46a92cd tempest-TestStampPattern-1263975939 None] attachment_update completed successfully. Jul 11 18:53:15 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.194s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:15 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:53:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Deleted volume successfully. Jul 11 18:53:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4fe856e2-05b5-485a-8283-5ac982fb5ad7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-d2a5589b-929e-4b72-bd5c-726ddfc98ade-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-b53cdadc-7321-4141-8b2e-b5a65c32d7fb req-4f4a93f3-5141-4cf2-b56c-8f3e67dd88b7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Terminate volume connection completed successfully. Jul 11 18:53:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-b53cdadc-7321-4141-8b2e-b5a65c32d7fb req-4f4a93f3-5141-4cf2-b56c-8f3e67dd88b7 tempest-TestInstancesWithCinderVolumes-1309651517 None] Deleting attachment ca7fc2c0-a983-4735-bce8-232ac21cfedf. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:53:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "cinder-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "cinder-quobyte-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-quobyte-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:19 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d9357c-b4d4-45c0-9f88-9b784d1fe1c9]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:19 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 Jul 11 18:53:19 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:20 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476" returned: 0 in 0.989s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:20 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476 Jul 11 18:53:20 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:21 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476" returned: 0 in 1.006s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-quobyte-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476" released by "delete_volume" :: held 2.052s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:21 devstack cinder-volume[87411]: WARNING cinder.quota [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25213362-319885433 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25213362-319885433, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:53:21 devstack cinder-volume[87411]: WARNING cinder.quota [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25213362-319885433 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25213362-319885433, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:53:21 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Created reservations ['632c03e5-af9b-44e6-966b-e41be568ea17', '7a413c34-483c-4a86-a3bd-eb3878caabaa', '38a7560a-3183-4895-a27f-44cfe3ad3226', 'c276662d-cdae-4e80-a0d4-088a6b44315e'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:53:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:21 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:53:21 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:22 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.899s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:22 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:53:22 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Deleted volume successfully. Jul 11 18:53:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ccd3fc7-d104-4cc8-b2c5-fafe0f56ca0e tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-ed6d908c-e333-4fd8-b3ae-b68ec4c6c476-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:22 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-d065290d-27b4-4977-8dea-40bfa295ffdd req-11d801b5-471f-4642-afa1-5907e75fa55c tempest-TestStampPattern-1263975939 None] Terminate volume connection completed successfully. Jul 11 18:53:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-d065290d-27b4-4977-8dea-40bfa295ffdd req-11d801b5-471f-4642-afa1-5907e75fa55c tempest-TestStampPattern-1263975939 None] Deleting attachment e4bee4ed-9f25-466a-a441-b904540df929. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:53:26 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-c77cee91-9e17-40b0-99d5-0710a21398c6 req-95ed4064-cc8f-4bf0-9ebd-8cf9cef0c393 tempest-TestInstancesWithCinderVolumes-1309651517 None] Terminate volume connection completed successfully. Jul 11 18:53:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-c77cee91-9e17-40b0-99d5-0710a21398c6 req-95ed4064-cc8f-4bf0-9ebd-8cf9cef0c393 tempest-TestInstancesWithCinderVolumes-1309651517 None] Deleting attachment 806707b2-12bd-4edf-9f63-1ba0cf937df5. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:53:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "cinder-23dc6fc0-852f-48ea-b740-7984b3b7bcfc-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-23dc6fc0-852f-48ea-b740-7984b3b7bcfc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "cinder-quobyte-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-quobyte-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:30 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c059b07a-90ef-418f-9d63-b8022b89fd1f]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:30 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc Jul 11 18:53:30 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:30 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" returned: 0 in 0.752s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:31 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc Jul 11 18:53:31 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:31 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" returned: 1 in 0.795s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:53:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:31 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc Jul 11 18:53:31 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:32 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" returned: 0 in 0.700s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-quobyte-23dc6fc0-852f-48ea-b740-7984b3b7bcfc" released by "delete_volume" :: held 2.316s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:32 devstack cinder-volume[87411]: WARNING cinder.quota [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-357292834-1674282691 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-357292834-1674282691, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:53:32 devstack cinder-volume[87411]: WARNING cinder.quota [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-357292834-1674282691 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-357292834-1674282691, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:53:32 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Created reservations ['5a9f3482-e0d6-4483-bc4e-ec8be3f5bcc0', 'e6d3c18c-77dc-4616-b9a6-41a7b9cb0132', '79df7d43-72fa-4812-8093-16ca19a7b1a9', 'bf257663-bc2b-4fe5-84f5-258a72ef95fc'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:53:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:32 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:53:32 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Acquiring lock "cinder-67585e43-f651-4041-b1fb-0e545a90a17c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Lock "cinder-67585e43-f651-4041-b1fb-0e545a90a17c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Acquiring lock "cinder-quobyte-67585e43-f651-4041-b1fb-0e545a90a17c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-67585e43-f651-4041-b1fb-0e545a90a17c" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:33 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a694e90-2cdf-4cf3-815f-cabda777cf8b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:33 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.718s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:33 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:53:33 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c Jul 11 18:53:33 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Deleted volume successfully. Jul 11 18:53:33 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-baa82f70-98d7-40c3-ba52-8bf0fffabe1f tempest-TestInstancesWithCinderVolumes-1309651517 None] Lock "cinder-23dc6fc0-852f-48ea-b740-7984b3b7bcfc-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:33 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c" returned: 0 in 0.809s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:33 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c Jul 11 18:53:33 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:34 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-67585e43-f651-4041-b1fb-0e545a90a17c" returned: 0 in 0.644s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-67585e43-f651-4041-b1fb-0e545a90a17c" released by "delete_volume" :: held 1.507s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=35,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=30,cinder:DELETE=3,cinder:SELECT=43,cinder:INSERT=5 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Created reservations ['6a9c43d1-1432-44ac-800f-67c8a0666e7e', 'bfe8ca90-f8cc-4ed0-a2a3-288e922fe903', '0bf76d21-79f4-4f0c-8d4f-6493a75cafd8', '183d793b-3dc2-4d67-80cf-f11898d689bb'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:34 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:53:34 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:35 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.721s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:53:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Deleted volume successfully. Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3a35b988-c115-45bb-b0ba-574adf5ee1e3 tempest-TestStampPattern-1263975939 None] Lock "cinder-67585e43-f651-4041-b1fb-0e545a90a17c-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Acquiring lock "cinder-80f378de-7ec8-4a85-9ba8-5c92f6b9a51c-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Lock "cinder-80f378de-7ec8-4a85-9ba8-5c92f6b9a51c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Acquiring lock "cinder-quobyte-0736d153-9495-4a7e-b4b4-69adbee2e6e4" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-0736d153-9495-4a7e-b4b4-69adbee2e6e4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Acquiring lock "cinder-quobyte-80f378de-7ec8-4a85-9ba8-5c92f6b9a51c" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-80f378de-7ec8-4a85-9ba8-5c92f6b9a51c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Deleting offline snapshot 80f378de-7ec8-4a85-9ba8-5c92f6b9a51c of volume 0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] snapshot_file for this snap is: volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7ab5d6-9bad-40a1-b018-690e4e1a5aa4]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:35 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c Jul 11 18:53:35 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Flow 'volume_create_manager' (433bc9d5-d628-4458-81e0-188e6f306aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029bfd27-7181-4747-957b-21ab24d385d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029bfd27-7181-4747-957b-21ab24d385d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1761600352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b7cc19-6e18-44d0-8c7a-399adb9c9edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a99db8fe1f8466f95c4981eb697dc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:36Z,use_quota=True,user_id='92251b5f8db3407eb1fb79b46341c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a889ff08-727a-405f-afb1-35261e9f17de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a889ff08-727a-405f-afb1-35261e9f17de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a62d96-8fe0-40f9-90cc-8a8e5423084e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a62d96-8fe0-40f9-90cc-8a8e5423084e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b7cc19-6e18-44d0-8c7a-399adb9c9edc', 'volume_name': 'volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31a3a3e-cdec-4288-a367-9b61382c76cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31a3a3e-cdec-4288-a367-9b61382c76cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9be0af-abf6-4048-a4d3-cc8cf158aee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:36 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Volume f7b7cc19-6e18-44d0-8c7a-399adb9c9edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc', 'volume_size': 1} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1761600352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b7cc19-6e18-44d0-8c7a-399adb9c9edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a99db8fe1f8466f95c4981eb697dc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:53:36Z,use_quota=True,user_id='92251b5f8db3407eb1fb79b46341c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Creating volume f7b7cc19-6e18-44d0-8c7a-399adb9c9edc {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:53:36 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:36 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc 1073741824 Jul 11 18:53:36 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:36 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c" returned: 0 in 0.896s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bafde9-0ee4-4276-b948-1c45dd596f7d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:36 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 Jul 11 18:53:36 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:37 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc 1073741824" returned: 0 in 0.998s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:37 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc Jul 11 18:53:37 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:37 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4" returned: 0 in 0.874s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:37 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c Jul 11 18:53:37 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:38 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc" returned: 0 in 0.714s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:53:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9be0af-abf6-4048-a4d3-cc8cf158aee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093e4df4-25c6-4272-a10c-b4c6c5be53bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:53:38 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Volume volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc (f7b7cc19-6e18-44d0-8c7a-399adb9c9edc): created successfully Jul 11 18:53:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093e4df4-25c6-4272-a10c-b4c6c5be53bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:53:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Flow 'volume_create_manager' (433bc9d5-d628-4458-81e0-188e6f306aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:53:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8047fbe2-2852-48d8-9d24-e31accae3bac tempest-AttachVolumeNegativeTest-1126116839 None] Created volume successfully. Jul 11 18:53:38 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c" returned: 0 in 0.886s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:38 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c Jul 11 18:53:38 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:39 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4.80f378de-7ec8-4a85-9ba8-5c92f6b9a51c" returned: 0 in 0.661s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-80f378de-7ec8-4a85-9ba8-5c92f6b9a51c" released by "_delete_snapshot" :: held 3.488s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-0736d153-9495-4a7e-b4b4-69adbee2e6e4" released by "delete_snapshot" :: held 3.514s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:39 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Created reservations ['c20a5fd8-a9fd-485f-b4ea-e7fb6d47bfb5', '346ec87a-32b4-47b1-a413-682b76a1ed51', 'dca60dc2-5c96-462b-add8-932cf8381122', '212a2ee2-736e-4934-b964-64c812970c00'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:53:39 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Delete snapshot completed successfully. Jul 11 18:53:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70533deb-5644-4240-aaf8-7d07148a12fd tempest-TestStampPattern-1263975939 None] Lock "cinder-80f378de-7ec8-4a85-9ba8-5c92f6b9a51c-delete_snapshot" released by "delete_snapshot" :: held 3.679s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-defc8bfe-5409-463d-a029-d07e537ce2fd req-60351ebf-c72f-4af5-b025-aed69ccf265a tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-defc8bfe-5409-463d-a029-d07e537ce2fd req-60351ebf-c72f-4af5-b025-aed69ccf265a tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:41 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e209f4-24d4-4298-bd2d-7119d644ecfe]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-defc8bfe-5409-463d-a029-d07e537ce2fd req-60351ebf-c72f-4af5-b025-aed69ccf265a tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:41 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc Jul 11 18:53:41 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:42 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-defc8bfe-5409-463d-a029-d07e537ce2fd req-60351ebf-c72f-4af5-b025-aed69ccf265a tempest-AttachVolumeNegativeTest-1126116839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc" returned: 0 in 0.920s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-defc8bfe-5409-463d-a029-d07e537ce2fd req-60351ebf-c72f-4af5-b025-aed69ccf265a tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.946s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-defc8bfe-5409-463d-a029-d07e537ce2fd req-60351ebf-c72f-4af5-b025-aed69ccf265a tempest-AttachVolumeNegativeTest-1126116839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3330351d-244a-47dd-b407-27d640483f35', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:53:42 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-defc8bfe-5409-463d-a029-d07e537ce2fd req-60351ebf-c72f-4af5-b025-aed69ccf265a tempest-AttachVolumeNegativeTest-1126116839 None] attachment_update completed successfully. Jul 11 18:53:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Acquiring lock "cinder-0736d153-9495-4a7e-b4b4-69adbee2e6e4-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Lock "cinder-0736d153-9495-4a7e-b4b4-69adbee2e6e4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Acquiring lock "cinder-quobyte-0736d153-9495-4a7e-b4b4-69adbee2e6e4" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:53:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-0736d153-9495-4a7e-b4b4-69adbee2e6e4" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:53:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2059bad-d80e-481c-bb45-934afdb2f85c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:53:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:48 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 Jul 11 18:53:48 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:49 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-91d6573c-48fb-47b8-a32e-332a50528232 req-815121c2-0558-439f-be5f-5b227fdceb7a tempest-AttachVolumeNegativeTest-1126116839 None] Terminate volume connection completed successfully. Jul 11 18:53:49 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-91d6573c-48fb-47b8-a32e-332a50528232 req-815121c2-0558-439f-be5f-5b227fdceb7a tempest-AttachVolumeNegativeTest-1126116839 None] Deleting attachment 3330351d-244a-47dd-b407-27d640483f35. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:53:49 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4" returned: 0 in 0.916s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:49 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4 Jul 11 18:53:49 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:50 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0736d153-9495-4a7e-b4b4-69adbee2e6e4" returned: 0 in 0.741s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Lock "cinder-quobyte-0736d153-9495-4a7e-b4b4-69adbee2e6e4" released by "delete_volume" :: held 1.721s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:50 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Created reservations ['a59d4caa-8a96-41be-ac70-6a15d879ebc2', 'f179e01c-7e55-41e1-959f-80d25ac8e7e9', '622dc163-29ce-4e89-97eb-6b8c60b623f7', '4a1b389b-fdb9-41c2-b796-d6564a93bb50'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:53:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:50 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:53:50 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:51 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.760s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:51 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:53:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Deleted volume successfully. Jul 11 18:53:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-9f99bceb-8ec4-4666-8554-10dd5e39a6bd tempest-TestStampPattern-1263975939 None] Lock "cinder-0736d153-9495-4a7e-b4b4-69adbee2e6e4-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:53:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:53:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:53:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:53:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:53:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:53:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:53:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:53:51 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:53:51 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:53:52 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jul 11 18:53:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.702s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:53:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:53:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:53:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:53:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:54:03 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=21,cinder:INSERT=4,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:54:03 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Flow 'volume_create_manager' (bc53885b-1c01-4611-8d48-3423637b7898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2df6ecf-413b-41bd-af7d-854a1cad8d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2df6ecf-413b-41bd-af7d-854a1cad8d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1426314669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2700f1dc-05b9-4051-958d-d4987178d34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4938bdc5b349f8a264ff8241ab6fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:11Z,use_quota=True,user_id='9b65ce4be272411bbc4645054854350f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136be95a-296a-4184-9572-f1789f67dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136be95a-296a-4184-9572-f1789f67dd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d711697e-1041-49d5-b5f0-6eac5fe24600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.image.glance [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Creating Keystone auth plugin from conf {{(pid=87411) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d711697e-1041-49d5-b5f0-6eac5fe24600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2700f1dc-05b9-4051-958d-d4987178d34f', 'volume_name': 'volume-2700f1dc-05b9-4051-958d-d4987178d34f', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b20f668-61d6-43ec-87bf-6d8b9b36a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b20f668-61d6-43ec-87bf-6d8b9b36a38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581caa6b-0ff7-49e7-9cf8-f919187a31c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:11 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Volume 2700f1dc-05b9-4051-958d-d4987178d34f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2700f1dc-05b9-4051-958d-d4987178d34f', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Trying to clone 2700f1dc-05b9-4051-958d-d4987178d34f from image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]). {{(pid=87411) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:54:11 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:54:11 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Image download 20.69 MB at 20.69 MB/s Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c05b8c7-5a40-4c32-b4dd-9d7562696e2f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:12 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD Jul 11 18:54:12 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Flow 'volume_create_manager' (088ace0e-765f-40d9-bccc-0e6dbc939b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc294c21-1a05-493f-bd83-7ce4a7778f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc294c21-1a05-493f-bd83-7ce4a7778f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac47bde-f7e7-4a71-8cff-694170d4a4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8039102718d04d939ae40edca415e137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:12Z,use_quota=True,user_id='cec86bd151b9403abe736b76ff798716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b3342b-2899-4e09-8cb2-b319928283d6),volume_type_id=e1b3342b-2899-4e09-8cb2-b319928283d6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdc598f-bd5a-4082-9a7a-00fab3913282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdc598f-bd5a-4082-9a7a-00fab3913282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87427c99-45dc-4e51-b0c2-22e35121ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.image.glance [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Creating Keystone auth plugin from conf {{(pid=87411) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87427c99-45dc-4e51-b0c2-22e35121ca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ac47bde-f7e7-4a71-8cff-694170d4a4cc', 'volume_name': 'volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc', 'volume_size': 1, 'image_id': 'a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f926ae0a23b4b9deae80078603ed9ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8039102718d04d939ae40edca415e137', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b673850428d21d60073ac133550df2f47d6e6efe71331586550ee5ae8b5d2612abf55a8a805561da977e7ac90f63df604556e9c520a2b0e776a49000401650f', 'id': 'a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'created_at': datetime.datetime(2026, 7, 11, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e0aa85-5287-428d-8aef-4297630ea944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e0aa85-5287-428d-8aef-4297630ea944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b7d62c-eb56-4e0c-bb0b-4da86311d107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:12 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Volume 0ac47bde-f7e7-4a71-8cff-694170d4a4cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc', 'volume_size': 1, 'image_id': 'a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f926ae0a23b4b9deae80078603ed9ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8039102718d04d939ae40edca415e137', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b673850428d21d60073ac133550df2f47d6e6efe71331586550ee5ae8b5d2612abf55a8a805561da977e7ac90f63df604556e9c520a2b0e776a49000401650f', 'id': 'a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'created_at': datetime.datetime(2026, 7, 11, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Trying to clone 0ac47bde-f7e7-4a71-8cff-694170d4a4cc from image a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'metadata': {}}]). {{(pid=87411) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:54:12 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Image download 0.00 MB at 0.00 MB/s Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e52d32-04ad-4335-827a-e51e2a0b4a5f]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:12 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD Jul 11 18:54:12 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:12 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Temporary image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 is fetched for user 9b65ce4be272411bbc4645054854350f. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e02313-ee42-46c4-bdf4-8f75229d09b2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:13 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD Jul 11 18:54:13 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:13 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD" returned: 0 in 0.740s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:13 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD Jul 11 18:54:13 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:13 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1426314669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2700f1dc-05b9-4051-958d-d4987178d34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4938bdc5b349f8a264ff8241ab6fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:11Z,use_quota=True,user_id='9b65ce4be272411bbc4645054854350f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Creating volume 2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:13 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:54:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:13 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f 1073741824 Jul 11 18:54:13 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:14 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD" returned: 1 in 0.722s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:14 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Temporary image a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b is fetched for user cec86bd151b9403abe736b76ff798716. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:54:14 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fc36ab-e1ad-4671-9978-589d1114546e]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:14 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD Jul 11 18:54:14 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:14 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f 1073741824" returned: 0 in 0.894s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:14 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:54:14 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:15 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD" returned: 0 in 0.823s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:15 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD Jul 11 18:54:15 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:15 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 0 in 0.781s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Attempting download of 7016bfdd-2d92-4c05-bebe-d2bb20b14820 ((None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}])) to volume 2700f1dc-05b9-4051-958d-d4987178d34f. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[0811ce57-b3cf-4f1f-bd07-06f01221d99d]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_qrmn1fhf {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:15 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_qrmn1fhf Jul 11 18:54:15 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:15 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD" returned: 1 in 0.862s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac47bde-f7e7-4a71-8cff-694170d4a4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8039102718d04d939ae40edca415e137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:12Z,use_quota=True,user_id='cec86bd151b9403abe736b76ff798716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b3342b-2899-4e09-8cb2-b319928283d6),volume_type_id=e1b3342b-2899-4e09-8cb2-b319928283d6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Creating volume 0ac47bde-f7e7-4a71-8cff-694170d4a4cc {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:15 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:54:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:15 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc 1073741824 Jul 11 18:54:15 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:16 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_qrmn1fhf" returned: 0 in 0.808s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_qrmn1fhf {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:16 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_qrmn1fhf Jul 11 18:54:16 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:16 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc 1073741824" returned: 0 in 1.058s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:17 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc Jul 11 18:54:17 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:17 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_qrmn1fhf" returned: 1 in 0.843s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7016bfdd-2d92-4c05-bebe-d2bb20b14820_qrmn1fhf' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[622f636e-f9af-498e-afec-1e6ae3eecd55]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:17 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD Jul 11 18:54:17 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:17 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc" returned: 0 in 0.658s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Attempting download of a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b ((None, [{'url': 'file:///opt/stack/data/glance/images/a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'metadata': {}}])) to volume 0ac47bde-f7e7-4a71-8cff-694170d4a4cc. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70a86e9-a3d3-44bf-9315-070e02df4bf8]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b__fjvaj1h {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:17 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b__fjvaj1h Jul 11 18:54:17 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:17 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] 7016bfdd-2d92-4c05-bebe-d2bb20b14820 was qcow2, converting to raw {{(pid=87411) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:54:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:17 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:54:17 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:18 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b__fjvaj1h" returned: 0 in 0.742s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b__fjvaj1h {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:18 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b__fjvaj1h Jul 11 18:54:18 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:19 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b__fjvaj1h" returned: 1 in 0.808s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b__fjvaj1h' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:19 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e645752-008a-4136-ba44-b9e0f2c2dcf1]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:19 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD Jul 11 18:54:19 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:19 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 0 in 1.924s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:19 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7016bfdd-2d92-4c05-bebe-d2bb20b14820_bg0pcywcdevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:54:19 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Converted 112.00 MB image at 58.19 MB/s Jul 11 18:54:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:19 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f 1G Jul 11 18:54:19 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:20 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD" returned: 0 in 0.767s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:20 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD Jul 11 18:54:20 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:20 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f 1G" returned: 0 in 1.058s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:20 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[358b3afc-c3b1-4639-9c41-9c6b9d5532be]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:21 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:54:21 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:21 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD" returned: 1 in 1.157s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:21 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b was raw, converting to raw {{(pid=87411) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:54:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:21 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc Jul 11 18:54:21 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:21 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 0 in 0.786s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:21 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:54:21 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:22 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc" returned: 0 in 0.847s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b_skmh5fd6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:54:22 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:22 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc 1G Jul 11 18:54:22 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:22 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 1 in 0.852s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Downloaded image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 ((None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}])) to volume 2700f1dc-05b9-4051-958d-d4987178d34f successfully. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Temporary image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 for user 9b65ce4be272411bbc4645054854350f is deleted. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Marking volume 2700f1dc-05b9-4051-958d-d4987178d34f as bootable. {{(pid=87411) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Copying metadata from image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 to 2700f1dc-05b9-4051-958d-d4987178d34f. {{(pid=87411) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Creating volume glance metadata for volume 2700f1dc-05b9-4051-958d-d4987178d34f backed by image 7016bfdd-2d92-4c05-bebe-d2bb20b14820 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87411) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581caa6b-0ff7-49e7-9cf8-f919187a31c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2700f1dc-05b9-4051-958d-d4987178d34f', 'volume_size': 1, 'image_id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7b205c0ea354709b1f8010bcda4fdb2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7016bfdd-2d92-4c05-bebe-d2bb20b14820', 'created_at': datetime.datetime(2026, 7, 11, 16, 33, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 33, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7016bfdd-2d92-4c05-bebe-d2bb20b14820/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fa0728-8f18-4698-b38b-3d79578712a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:22 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Volume volume-2700f1dc-05b9-4051-958d-d4987178d34f (2700f1dc-05b9-4051-958d-d4987178d34f): created successfully Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fa0728-8f18-4698-b38b-3d79578712a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Flow 'volume_create_manager' (bc53885b-1c01-4611-8d48-3423637b7898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:22 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:22 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1b3e908a-14f9-4b5c-91fe-f9f1f5465eac tempest-TestShelveInstance-1461389212 None] Created volume successfully. Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc 1G" returned: 0 in 0.749s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[43806d2c-4f5c-4a6e-a5c0-d1cb336e21c2]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:23 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc Jul 11 18:54:23 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:23 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc" returned: 0 in 0.877s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:23 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc Jul 11 18:54:23 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:24 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc" returned: 1 in 0.886s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Downloaded image a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b ((None, [{'url': 'file:///opt/stack/data/glance/images/a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'metadata': {}}])) to volume 0ac47bde-f7e7-4a71-8cff-694170d4a4cc successfully. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Temporary image a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b for user cec86bd151b9403abe736b76ff798716 is deleted. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Marking volume 0ac47bde-f7e7-4a71-8cff-694170d4a4cc as bootable. {{(pid=87411) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Copying metadata from image a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b to 0ac47bde-f7e7-4a71-8cff-694170d4a4cc. {{(pid=87411) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Creating volume glance metadata for volume 0ac47bde-f7e7-4a71-8cff-694170d4a4cc backed by image a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4f926ae0a23b4b9deae80078603ed9ff', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87411) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b7d62c-eb56-4e0c-bb0b-4da86311d107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc', 'volume_size': 1, 'image_id': 'a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f926ae0a23b4b9deae80078603ed9ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8039102718d04d939ae40edca415e137', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b673850428d21d60073ac133550df2f47d6e6efe71331586550ee5ae8b5d2612abf55a8a805561da977e7ac90f63df604556e9c520a2b0e776a49000401650f', 'id': 'a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b', 'created_at': datetime.datetime(2026, 7, 11, 16, 54, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 54, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5f5fecf-9567-4ca7-b223-dbbbd7ba3c1b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7627fa70-2bcc-42f6-ab37-5b39cd08e1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:24 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Volume volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc (0ac47bde-f7e7-4a71-8cff-694170d4a4cc): created successfully Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7627fa70-2bcc-42f6-ab37-5b39cd08e1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Flow 'volume_create_manager' (088ace0e-765f-40d9-bccc-0e6dbc939b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d8510946-0a68-48c4-8fdf-625130040ea4 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Created volume successfully. Jul 11 18:54:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Acquiring lock "cinder-0ac47bde-f7e7-4a71-8cff-694170d4a4cc-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Lock "cinder-0ac47bde-f7e7-4a71-8cff-694170d4a4cc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Acquiring lock "cinder-quobyte-0ac47bde-f7e7-4a71-8cff-694170d4a4cc" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Lock "cinder-quobyte-0ac47bde-f7e7-4a71-8cff-694170d4a4cc" acquired by "delete_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:25 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8774a05e-7816-4e91-b1e1-cefb1ae3d613]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:25 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc Jul 11 18:54:25 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:26 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc" returned: 0 in 0.860s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:26 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc Jul 11 18:54:26 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:27 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc" returned: 1 in 0.818s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:27 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc Jul 11 18:54:27 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:27 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0ac47bde-f7e7-4a71-8cff-694170d4a4cc" returned: 0 in 0.651s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Lock "cinder-quobyte-0ac47bde-f7e7-4a71-8cff-694170d4a4cc" released by "delete_volume" :: held 2.430s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:27 devstack cinder-volume[87411]: WARNING cinder.quota [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:54:27 devstack cinder-volume[87411]: WARNING cinder.quota [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Created reservations ['cf7491b5-42d9-4575-9040-3b6dfd36a8ef', '47a6974e-ca19-48b9-aa69-b489b2220db2', 'b5494f15-32f4-4f34-8283-6ea77f2c733a', '25898ca4-300f-45dd-abea-0a9554c25016'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:27 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:54:27 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:28 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.623s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:28 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:28 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Deleted volume successfully. Jul 11 18:54:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-586e9f48-aa2a-4cde-86b0-835d855c00a5 tempest-VolumeAndVolumeTypeFromImageTest-1863182211 None] Lock "cinder-0ac47bde-f7e7-4a71-8cff-694170d4a4cc-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-8f50d415-b017-4f42-99bd-3f23fb4f1c8b req-a75bb24b-3d8e-447e-9510-9554f3f73596 tempest-TestShelveInstance-1461389212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-8f50d415-b017-4f42-99bd-3f23fb4f1c8b req-a75bb24b-3d8e-447e-9510-9554f3f73596 tempest-TestShelveInstance-1461389212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:30 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc20ed5-441e-4ba4-9b79-d6c0261f1fe4]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-8f50d415-b017-4f42-99bd-3f23fb4f1c8b req-a75bb24b-3d8e-447e-9510-9554f3f73596 tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:31 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:54:31 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:31 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-8f50d415-b017-4f42-99bd-3f23fb4f1c8b req-a75bb24b-3d8e-447e-9510-9554f3f73596 tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 0 in 1.081s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-8f50d415-b017-4f42-99bd-3f23fb4f1c8b req-a75bb24b-3d8e-447e-9510-9554f3f73596 tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:32 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:54:32 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:32 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-8f50d415-b017-4f42-99bd-3f23fb4f1c8b req-a75bb24b-3d8e-447e-9510-9554f3f73596 tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 1 in 1.010s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-8f50d415-b017-4f42-99bd-3f23fb4f1c8b req-a75bb24b-3d8e-447e-9510-9554f3f73596 tempest-TestShelveInstance-1461389212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:54:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-8f50d415-b017-4f42-99bd-3f23fb4f1c8b req-a75bb24b-3d8e-447e-9510-9554f3f73596 tempest-TestShelveInstance-1461389212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.164s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-8f50d415-b017-4f42-99bd-3f23fb4f1c8b req-a75bb24b-3d8e-447e-9510-9554f3f73596 tempest-TestShelveInstance-1461389212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-2700f1dc-05b9-4051-958d-d4987178d34f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b075830c-a3a5-496e-9c98-0f80d405b05d', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:54:33 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-8f50d415-b017-4f42-99bd-3f23fb4f1c8b req-a75bb24b-3d8e-447e-9510-9554f3f73596 tempest-TestShelveInstance-1461389212 None] attachment_update completed successfully. Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Flow 'volume_create_manager' (267ef1ef-9143-474a-9dfe-9de654e03c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0386deed-20b7-41c4-a605-c71ad3fcd255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0386deed-20b7-41c4-a605-c71ad3fcd255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647681781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a3c624-59d0-4f77-a425-5c6d09930ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60989d89c94a4c0b902c5fa0c8bde5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:34Z,use_quota=True,user_id='e4b37a8b03824e6197b22b93d2a57417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f70a9d-1b19-4a64-b982-1fe48cbd193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f70a9d-1b19-4a64-b982-1fe48cbd193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ae08a0-b866-41cb-86b1-588af6dfc680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ae08a0-b866-41cb-86b1-588af6dfc680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a3c624-59d0-4f77-a425-5c6d09930ba0', 'volume_name': 'volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9baf0e91-cb5c-414f-b710-aee46f151d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9baf0e91-cb5c-414f-b710-aee46f151d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c650c02-c7a7-4110-b98e-51eaa4124843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:34 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Volume a9a3c624-59d0-4f77-a425-5c6d09930ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0', 'volume_size': 1} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647681781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a3c624-59d0-4f77-a425-5c6d09930ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60989d89c94a4c0b902c5fa0c8bde5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:34Z,use_quota=True,user_id='e4b37a8b03824e6197b22b93d2a57417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Creating volume a9a3c624-59d0-4f77-a425-5c6d09930ba0 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:34 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:34 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0 1073741824 Jul 11 18:54:34 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Flow 'volume_create_manager' (7465a874-30fd-4066-b8f6-bf6a47cc8ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e319268e-b78d-4d0e-8aad-43cb2bf88d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e319268e-b78d-4d0e-8aad-43cb2bf88d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1211279100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7436e2-e4b7-44f7-b807-0461945a6e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60989d89c94a4c0b902c5fa0c8bde5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:35Z,use_quota=True,user_id='e4b37a8b03824e6197b22b93d2a57417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3a2205-4ae6-404c-9fc7-0c7f33da15a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb3a2205-4ae6-404c-9fc7-0c7f33da15a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8b9087-ee20-4605-a432-d3400e1c6a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c8b9087-ee20-4605-a432-d3400e1c6a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7436e2-e4b7-44f7-b807-0461945a6e54', 'volume_name': 'volume-ae7436e2-e4b7-44f7-b807-0461945a6e54', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fee52c-c232-4539-ab0a-00ee7aa59065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fee52c-c232-4539-ab0a-00ee7aa59065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6716f61b-2074-4969-93cb-4abdf4ce4ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:34 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Volume ae7436e2-e4b7-44f7-b807-0461945a6e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7436e2-e4b7-44f7-b807-0461945a6e54', 'volume_size': 1} Jul 11 18:54:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Flow 'volume_create_manager' (49bcfba2-4d6b-4d5d-9903-ade1d1701019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24ebc45-3ef6-4cbb-8ea9-308d70e1e334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24ebc45-3ef6-4cbb-8ea9-308d70e1e334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-121275571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8263120-9840-4422-99ab-4c047a966146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60989d89c94a4c0b902c5fa0c8bde5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:35Z,use_quota=True,user_id='e4b37a8b03824e6197b22b93d2a57417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e390eb53-daf9-4ebd-9c54-65c0ac97f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e390eb53-daf9-4ebd-9c54-65c0ac97f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36690dc-e508-4ac1-86a0-56d8e06e6532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36690dc-e508-4ac1-86a0-56d8e06e6532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8263120-9840-4422-99ab-4c047a966146', 'volume_name': 'volume-b8263120-9840-4422-99ab-4c047a966146', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc7cafb-ba75-4261-a709-65509dc91059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc7cafb-ba75-4261-a709-65509dc91059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5957537b-e7d9-477d-9c52-6f69ba7c837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:35 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Volume b8263120-9840-4422-99ab-4c047a966146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8263120-9840-4422-99ab-4c047a966146', 'volume_size': 1} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:35 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0 1073741824" returned: 0 in 1.339s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Flow 'volume_create_manager' (87d475e9-7008-46c1-aa1a-d64a447c1f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1044d9c1-06cb-4c50-832e-45ddd6cab392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1044d9c1-06cb-4c50-832e-45ddd6cab392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100926969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60989d89c94a4c0b902c5fa0c8bde5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:36Z,use_quota=True,user_id='e4b37a8b03824e6197b22b93d2a57417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a7736d-8ff8-4181-93dd-92061144b604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a7736d-8ff8-4181-93dd-92061144b604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9705371e-584e-42e6-bdb5-108dee0136a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9705371e-584e-42e6-bdb5-108dee0136a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c', 'volume_name': 'volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9439af62-1c33-435d-ad30-15afb294eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9439af62-1c33-435d-ad30-15afb294eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b9679b-e41c-4d8d-adc6-c8f9327432a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:35 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Volume b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c', 'volume_size': 1} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:35 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0 Jul 11 18:54:35 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Flow 'volume_create_manager' (72da81e5-c6a3-4653-90dc-debe47a0fa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d11559-18ff-4150-a07d-b670d6591dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d11559-18ff-4150-a07d-b670d6591dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1758795458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24743c51-59ae-4471-a17b-70f46659d310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60989d89c94a4c0b902c5fa0c8bde5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:36Z,use_quota=True,user_id='e4b37a8b03824e6197b22b93d2a57417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efd0a41-1b13-41a6-9eca-fad1c40034cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efd0a41-1b13-41a6-9eca-fad1c40034cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5157d3-f258-42ff-bb78-4361df7a6aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5157d3-f258-42ff-bb78-4361df7a6aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24743c51-59ae-4471-a17b-70f46659d310', 'volume_name': 'volume-24743c51-59ae-4471-a17b-70f46659d310', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4edfb7b-d9b9-45f2-ac27-82e9b758028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4edfb7b-d9b9-45f2-ac27-82e9b758028a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067b2737-0f84-4f34-8a4d-9babf861c7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Volume 24743c51-59ae-4471-a17b-70f46659d310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24743c51-59ae-4471-a17b-70f46659d310', 'volume_size': 1} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:36 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0" returned: 0 in 0.640s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.667s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1211279100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7436e2-e4b7-44f7-b807-0461945a6e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60989d89c94a4c0b902c5fa0c8bde5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:35Z,use_quota=True,user_id='e4b37a8b03824e6197b22b93d2a57417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Creating volume ae7436e2-e4b7-44f7-b807-0461945a6e54 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:36 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c650c02-c7a7-4110-b98e-51eaa4124843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:36 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54 1073741824 Jul 11 18:54:36 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1a4360-d1ce-42ef-a66a-12ca168c7af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:36 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Volume volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0 (a9a3c624-59d0-4f77-a425-5c6d09930ba0): created successfully Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1a4360-d1ce-42ef-a66a-12ca168c7af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Flow 'volume_create_manager' (267ef1ef-9143-474a-9dfe-9de654e03c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f2da4067-e00e-42c5-bb8f-62d2dcfb20d3 tempest-CreateVolumesFromImageTest-1160574201 None] Created volume successfully. Jul 11 18:54:37 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54 1073741824" returned: 0 in 1.094s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:37 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54 Jul 11 18:54:37 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:38 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54" returned: 0 in 0.630s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.755s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-121275571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8263120-9840-4422-99ab-4c047a966146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60989d89c94a4c0b902c5fa0c8bde5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:35Z,use_quota=True,user_id='e4b37a8b03824e6197b22b93d2a57417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Creating volume b8263120-9840-4422-99ab-4c047a966146 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:38 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6716f61b-2074-4969-93cb-4abdf4ce4ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7436e2-e4b7-44f7-b807-0461945a6e54', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:38 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146 1073741824 Jul 11 18:54:38 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42766929-5fe2-442e-b079-c079cd4e5acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:38 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Volume volume-ae7436e2-e4b7-44f7-b807-0461945a6e54 (ae7436e2-e4b7-44f7-b807-0461945a6e54): created successfully Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42766929-5fe2-442e-b079-c079cd4e5acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Flow 'volume_create_manager' (7465a874-30fd-4066-b8f6-bf6a47cc8ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8e454cf6-7185-4780-bcc9-85369c7b5cda tempest-CreateVolumesFromImageTest-1160574201 None] Created volume successfully. Jul 11 18:54:39 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146 1073741824" returned: 0 in 0.855s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:39 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146 Jul 11 18:54:39 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:39 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146" returned: 0 in 0.682s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.026s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100926969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60989d89c94a4c0b902c5fa0c8bde5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:36Z,use_quota=True,user_id='e4b37a8b03824e6197b22b93d2a57417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Creating volume b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:39 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:39 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c 1073741824 Jul 11 18:54:39 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5957537b-e7d9-477d-9c52-6f69ba7c837e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8263120-9840-4422-99ab-4c047a966146', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b01ddef-5a84-46fe-8590-6cf6b834d749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:39 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Volume volume-b8263120-9840-4422-99ab-4c047a966146 (b8263120-9840-4422-99ab-4c047a966146): created successfully Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b01ddef-5a84-46fe-8590-6cf6b834d749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Flow 'volume_create_manager' (49bcfba2-4d6b-4d5d-9903-ade1d1701019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-727805a5-6d78-48b1-85f0-e6fc02c1777c tempest-CreateVolumesFromImageTest-1160574201 None] Created volume successfully. Jul 11 18:54:41 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c 1073741824" returned: 0 in 1.106s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:41 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c Jul 11 18:54:41 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:41 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c" returned: 0 in 0.755s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.579s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1758795458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24743c51-59ae-4471-a17b-70f46659d310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60989d89c94a4c0b902c5fa0c8bde5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:36Z,use_quota=True,user_id='e4b37a8b03824e6197b22b93d2a57417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Creating volume 24743c51-59ae-4471-a17b-70f46659d310 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:41 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b9679b-e41c-4d8d-adc6-c8f9327432a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659601d0-c8e0-467e-87ce-85231d246966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:41 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310 1073741824 Jul 11 18:54:41 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Volume volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c (b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c): created successfully Jul 11 18:54:41 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659601d0-c8e0-467e-87ce-85231d246966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Flow 'volume_create_manager' (87d475e9-7008-46c1-aa1a-d64a447c1f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:41 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6e6abf01-5ea5-44e4-9f1a-c1771f74ef83 tempest-CreateVolumesFromImageTest-1160574201 None] Created volume successfully. Jul 11 18:54:42 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310 1073741824" returned: 0 in 1.134s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:43 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310 Jul 11 18:54:43 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:43 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310" returned: 0 in 0.804s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067b2737-0f84-4f34-8a4d-9babf861c7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24743c51-59ae-4471-a17b-70f46659d310', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f517179-365a-40f0-bfea-a8a5ba944ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:43 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Volume volume-24743c51-59ae-4471-a17b-70f46659d310 (24743c51-59ae-4471-a17b-70f46659d310): created successfully Jul 11 18:54:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f517179-365a-40f0-bfea-a8a5ba944ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Flow 'volume_create_manager' (72da81e5-c6a3-4653-90dc-debe47a0fa7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:43 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c5247ac0-afe9-44ed-8087-2ad07a6c01da tempest-CreateVolumesFromImageTest-1160574201 None] Created volume successfully. Jul 11 18:54:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "cinder-24743c51-59ae-4471-a17b-70f46659d310-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-24743c51-59ae-4471-a17b-70f46659d310-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "cinder-quobyte-24743c51-59ae-4471-a17b-70f46659d310" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-quobyte-24743c51-59ae-4471-a17b-70f46659d310" acquired by "delete_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:44 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[25458cb5-ad81-4de5-a34a-960c112c4546]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:44 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310 Jul 11 18:54:44 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:45 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310" returned: 0 in 0.774s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:45 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310 Jul 11 18:54:45 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:45 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-24743c51-59ae-4471-a17b-70f46659d310" returned: 0 in 0.743s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-quobyte-24743c51-59ae-4471-a17b-70f46659d310" released by "delete_volume" :: held 1.573s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Created reservations ['2bc95a8e-0da0-4a2b-9533-ff8c45126761', '0b0b0992-4b15-4dd0-b641-9046d85de76c', '14898ca8-67f5-4772-aed0-61c8455f6a55', '1b15fcb4-3caf-456c-99be-ea111026ce5c'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:45 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:54:45 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Flow 'volume_create_manager' (3aea4021-e9da-4af9-b27e-02b552b33c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d034ae-1706-46f4-8382-adc1b7748a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "cinder-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d034ae-1706-46f4-8382-adc1b7748a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1367282532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a193f645-e938-4bcf-9005-f735eedf161f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a99db8fe1f8466f95c4981eb697dc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:46Z,use_quota=True,user_id='92251b5f8db3407eb1fb79b46341c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efda5cfa-a41e-412a-9232-f82c0f7d8da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efda5cfa-a41e-412a-9232-f82c0f7d8da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b940fc89-954b-41a0-b62e-b7ebc230feed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b940fc89-954b-41a0-b62e-b7ebc230feed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a193f645-e938-4bcf-9005-f735eedf161f', 'volume_name': 'volume-a193f645-e938-4bcf-9005-f735eedf161f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827b2697-86c6-4969-ac00-ccdeac972cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827b2697-86c6-4969-ac00-ccdeac972cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2810c41d-0bf3-4579-9a3d-8cbf811b83c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:46 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Volume a193f645-e938-4bcf-9005-f735eedf161f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a193f645-e938-4bcf-9005-f735eedf161f', 'volume_size': 1} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1367282532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a193f645-e938-4bcf-9005-f735eedf161f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a99db8fe1f8466f95c4981eb697dc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:46Z,use_quota=True,user_id='92251b5f8db3407eb1fb79b46341c339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Creating volume a193f645-e938-4bcf-9005-f735eedf161f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:46 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:46 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f 1073741824 Jul 11 18:54:46 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "cinder-quobyte-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-quobyte-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d72cd-2cb0-4c1e-a61a-ac6d5c283598]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:46 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.987s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:46 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c Jul 11 18:54:46 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:46 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Deleted volume successfully. Jul 11 18:54:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b3822a10-fc25-4916-a1a9-83d710eaa557 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-24743c51-59ae-4471-a17b-70f46659d310-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:47 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c" returned: 0 in 0.819s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:47 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c Jul 11 18:54:47 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:47 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f 1073741824" returned: 0 in 1.068s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:47 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f Jul 11 18:54:47 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:48 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c" returned: 0 in 0.689s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-quobyte-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c" released by "delete_volume" :: held 1.584s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:48 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Created reservations ['f1af2732-31c7-412e-9c47-6f2313915960', 'b6d97b1d-d1eb-4bb2-b41e-bdc252bb0a8d', '9ccb5e00-d227-4edb-816a-85746fba6246', '3f418221-a442-4f78-9030-98a89a65bb25'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f" returned: 0 in 0.659s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2810c41d-0bf3-4579-9a3d-8cbf811b83c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a193f645-e938-4bcf-9005-f735eedf161f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e895a922-4798-4528-b18f-9d160b278293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:48 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Volume volume-a193f645-e938-4bcf-9005-f735eedf161f (a193f645-e938-4bcf-9005-f735eedf161f): created successfully Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e895a922-4798-4528-b18f-9d160b278293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Flow 'volume_create_manager' (3aea4021-e9da-4af9-b27e-02b552b33c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:48 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5a4c9fa4-250d-4a61-b8ce-8681e26f81ee tempest-AttachVolumeNegativeTest-1126116839 None] Created volume successfully. Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:48 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:54:48 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "cinder-b8263120-9840-4422-99ab-4c047a966146-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-b8263120-9840-4422-99ab-4c047a966146-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "cinder-quobyte-b8263120-9840-4422-99ab-4c047a966146" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-quobyte-b8263120-9840-4422-99ab-4c047a966146" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fefffe4-64cf-4629-a765-b535c9092463]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:49 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146 Jul 11 18:54:49 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:49 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.673s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:49 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:49 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Deleted volume successfully. Jul 11 18:54:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-84715d03-cc42-4432-ae07-b1458ba6eb44 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-b9dbc7a0-7f2b-4bcc-a640-e41b99ec1e9c-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:49 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146" returned: 0 in 0.809s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:49 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146 Jul 11 18:54:49 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:50 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b8263120-9840-4422-99ab-4c047a966146" returned: 0 in 0.679s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-quobyte-b8263120-9840-4422-99ab-4c047a966146" released by "delete_volume" :: held 1.531s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:50 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Created reservations ['4af72818-16cc-456f-88aa-b7645a044d0d', 'd2c963a7-6b45-44cc-b030-73395da26c29', 'edcf70c6-ebec-41f0-acd6-407c1f7d1e02', '67de76ad-64d2-4672-93fe-befc4d33ce08'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:50 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:54:50 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "cinder-ae7436e2-e4b7-44f7-b807-0461945a6e54-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-ae7436e2-e4b7-44f7-b807-0461945a6e54-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "cinder-quobyte-ae7436e2-e4b7-44f7-b807-0461945a6e54" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-quobyte-ae7436e2-e4b7-44f7-b807-0461945a6e54" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[158dd11d-25fe-4ec6-85b8-31be532c59c7]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:51 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.709s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Deleted volume successfully. Jul 11 18:54:51 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54 Jul 11 18:54:51 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c70a65-f30c-4514-a2c0-d3c8474cc393 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-b8263120-9840-4422-99ab-4c047a966146-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:51 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:54:51 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:52 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54" returned: 0 in 0.843s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:52 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54 Jul 11 18:54:52 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:52 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.835s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-6181cafa-17b1-417b-9224-64cd9c4126be req-39c2343b-2f9e-4925-817c-cd9f9208c5f2 tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-6181cafa-17b1-417b-9224-64cd9c4126be req-39c2343b-2f9e-4925-817c-cd9f9208c5f2 tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec394144-f3e6-486d-ad0b-b802eaa59375]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-6181cafa-17b1-417b-9224-64cd9c4126be req-39c2343b-2f9e-4925-817c-cd9f9208c5f2 tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:52 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ae7436e2-e4b7-44f7-b807-0461945a6e54" returned: 0 in 0.740s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-quobyte-ae7436e2-e4b7-44f7-b807-0461945a6e54" released by "delete_volume" :: held 1.642s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:52 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f Jul 11 18:54:52 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Created reservations ['3ed0300e-9d76-4858-a7e4-446e2eb6fad2', 'aa5ee9d4-53fb-4ef2-8a0f-1e320841f48e', 'aeeef62a-5c17-489a-9ae4-b67f223fd5dc', 'ad2ba058-9312-4991-86f9-c1256bfedf9c'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:52 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:54:53 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "cinder-a9a3c624-59d0-4f77-a425-5c6d09930ba0-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-a9a3c624-59d0-4f77-a425-5c6d09930ba0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "cinder-quobyte-a9a3c624-59d0-4f77-a425-5c6d09930ba0" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-quobyte-a9a3c624-59d0-4f77-a425-5c6d09930ba0" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af06c76-636d-4a4d-b026-59d584d33320]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:53 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-6181cafa-17b1-417b-9224-64cd9c4126be req-39c2343b-2f9e-4925-817c-cd9f9208c5f2 tempest-AttachVolumeNegativeTest-1126116839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f" returned: 0 in 0.951s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-6181cafa-17b1-417b-9224-64cd9c4126be req-39c2343b-2f9e-4925-817c-cd9f9208c5f2 tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.969s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:53 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0 Jul 11 18:54:53 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:53 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.735s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:53 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Deleted volume successfully. Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-6181cafa-17b1-417b-9224-64cd9c4126be req-39c2343b-2f9e-4925-817c-cd9f9208c5f2 tempest-AttachVolumeNegativeTest-1126116839 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-a193f645-e938-4bcf-9005-f735eedf161f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5c77297-5972-4bac-a072-c811ca31e754', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:54:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-81702c7f-124b-43a5-9562-8661af92026b tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-ae7436e2-e4b7-44f7-b807-0461945a6e54-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:53 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-6181cafa-17b1-417b-9224-64cd9c4126be req-39c2343b-2f9e-4925-817c-cd9f9208c5f2 tempest-AttachVolumeNegativeTest-1126116839 None] attachment_update completed successfully. Jul 11 18:54:54 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0" returned: 0 in 0.972s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:54 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0 Jul 11 18:54:54 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:55 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a9a3c624-59d0-4f77-a425-5c6d09930ba0" returned: 0 in 0.701s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-quobyte-a9a3c624-59d0-4f77-a425-5c6d09930ba0" released by "delete_volume" :: held 1.732s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:55 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Created reservations ['ac14b3ff-2015-4863-adce-caa9b8045291', 'dafa85c7-0aec-4614-8461-fcd95cdcd167', '06e0802c-1dac-4cfd-bec9-d2bf9d833011', '4afed73d-3e7a-405c-91ee-f014a28f60de'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:54:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:55 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:54:55 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:56 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.661s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:56 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:54:56 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Deleted volume successfully. Jul 11 18:54:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1bd778b1-679a-4b3b-86ee-c6138d94dfa4 tempest-CreateVolumesFromImageTest-1160574201 None] Lock "cinder-a9a3c624-59d0-4f77-a425-5c6d09930ba0-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Flow 'volume_create_manager' (8734924e-dc47-4b84-83a2-c5643402f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae89865-6d6e-4faa-8b05-c20b020508d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae89865-6d6e-4faa-8b05-c20b020508d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-361767277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4932779a53cb4ab8aeb7b8d267b91841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:58Z,use_quota=True,user_id='1fb668765b0b4e0e80714b4636c41652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258a3c22-05e1-4a08-87b7-e3e4e76f4283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258a3c22-05e1-4a08-87b7-e3e4e76f4283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16846286-b12f-42c8-aba7-e48f1037b963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16846286-b12f-42c8-aba7-e48f1037b963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25', 'volume_name': 'volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bd796e-7259-474e-bffa-73ed1b4e4f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77bd796e-7259-474e-bffa-73ed1b4e4f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0387daee-0304-4a53-bb08-509842b03d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:54:58 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Volume a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25', 'volume_size': 1} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-361767277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4932779a53cb4ab8aeb7b8d267b91841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:54:58Z,use_quota=True,user_id='1fb668765b0b4e0e80714b4636c41652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Creating volume a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:54:58 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:54:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:58 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 1073741824 Jul 11 18:54:58 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:54:59 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-fb915331-2440-44d9-a5b8-a0d70c67846c req-0bf047d7-0b13-46e5-bdf3-87a4fa040361 tempest-AttachVolumeNegativeTest-1126116839 None] Terminate volume connection completed successfully. Jul 11 18:54:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-fb915331-2440-44d9-a5b8-a0d70c67846c req-0bf047d7-0b13-46e5-bdf3-87a4fa040361 tempest-AttachVolumeNegativeTest-1126116839 None] Deleting attachment d5c77297-5972-4bac-a072-c811ca31e754. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:54:59 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Jul 11 18:54:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 1073741824" returned: 0 in 0.849s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:54:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:54:59 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 Jul 11 18:54:59 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:00 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" returned: 0 in 0.628s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0387daee-0304-4a53-bb08-509842b03d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7266a30-6bfc-4193-83cd-26239335e0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:00 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Volume volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 (a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25): created successfully Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7266a30-6bfc-4193-83cd-26239335e0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Flow 'volume_create_manager' (8734924e-dc47-4b84-83a2-c5643402f48e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:00 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-dd82e86a-3be6-42ae-82f8-9b5c7417c63b tempest-VolumeDependencyTests-1178583818 None] Created volume successfully. Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Creating offline snapshot ef6ee550-e9a9-404e-bd00-9aafec8e4207 of volume a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a45742-cddf-49e5-a8e1-38963fc70761]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:01 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 Jul 11 18:55:01 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:01 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" returned: 0 in 0.951s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:01 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 1G Jul 11 18:55:01 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:02 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 1G" returned: 0 in 0.848s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:02 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 Jul 11 18:55:02 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:03 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207" returned: 0 in 0.820s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:03 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 is being set with open permissions: ugo+rw Jul 11 18:55:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:03 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 Jul 11 18:55:03 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:04 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207" returned: 0 in 0.696s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:04 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=90,cinder:UPDATE=80,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:55:04 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=83,cinder:SELECT=61,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:55:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:04 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.info Jul 11 18:55:04 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:05 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.info" returned: 0 in 0.687s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:05 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.info is being set with open permissions: ugo+rw Jul 11 18:55:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:05 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.info Jul 11 18:55:05 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:05 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.info" returned: 0 in 0.681s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.802s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0d1c1a04-11c6-4f9a-8c91-6dae56ad248a tempest-VolumeDependencyTests-1178583818 None] Create snapshot completed successfully Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Flow 'volume_create_manager' (9cd6b9e1-7eb3-4915-897b-fadf735c4e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef32678-3f3e-4d98-a8af-6b3d38059a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef32678-3f3e-4d98-a8af-6b3d38059a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-138911395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4932779a53cb4ab8aeb7b8d267b91841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef6ee550-e9a9-404e-bd00-9aafec8e4207,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:07Z,use_quota=True,user_id='1fb668765b0b4e0e80714b4636c41652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53437538-1541-4e6a-9c88-5b60dbb08c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53437538-1541-4e6a-9c88-5b60dbb08c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50456f49-765a-4d5c-9502-d97051b94af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50456f49-765a-4d5c-9502-d97051b94af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9', 'volume_name': 'volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9', 'volume_size': 1, 'snapshot_id': 'ef6ee550-e9a9-404e-bd00-9aafec8e4207'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a52b507-4544-4789-8723-17c4e31acfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a52b507-4544-4789-8723-17c4e31acfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a235e0-8991-4922-ad98-0da95e5b0c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:06 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Volume 6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9', 'volume_size': 1, 'snapshot_id': 'ef6ee550-e9a9-404e-bd00-9aafec8e4207'} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "cinder-quobyte-ef6ee550-e9a9-404e-bd00-9aafec8e4207-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" by "_create_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-ef6ee550-e9a9-404e-bd00-9aafec8e4207-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Creating volume 6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 from snapshot ef6ee550-e9a9-404e-bd00-9aafec8e4207 {{(pid=87411) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "cinder-quobyte-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] snapshot: ef6ee550-e9a9-404e-bd00-9aafec8e4207, volume: 6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[4369d9ef-e7a9-4702-9f1b-678472325b10]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:06 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 Jul 11 18:55:06 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:07 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207" returned: 0 in 0.814s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:55:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:55:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:55:07 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcea159-e3a7-4053-ae20-780e602fa9b9]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:07 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 Jul 11 18:55:07 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:08 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" returned: 0 in 0.762s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:08 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:55:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:08 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 Jul 11 18:55:08 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "cinder-a193f645-e938-4bcf-9005-f735eedf161f-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-a193f645-e938-4bcf-9005-f735eedf161f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "cinder-quobyte-a193f645-e938-4bcf-9005-f735eedf161f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-quobyte-a193f645-e938-4bcf-9005-f735eedf161f" acquired by "delete_volume" :: waited 0.045s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:10 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd7d31b-047c-4853-bea6-b15d5f284f10]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:10 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f Jul 11 18:55:10 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:12 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f" returned: 0 in 1.684s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:12 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f Jul 11 18:55:12 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:13 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-bbc6d987-8d5a-4dad-b3a3-7c57565268de req-c4725b31-31d6-4cef-b840-11282df6204d tempest-TestShelveInstance-1461389212 None] Terminate volume connection completed successfully. Jul 11 18:55:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-bbc6d987-8d5a-4dad-b3a3-7c57565268de req-c4725b31-31d6-4cef-b840-11282df6204d tempest-TestShelveInstance-1461389212 None] Deleting attachment b075830c-a3a5-496e-9c98-0f80d405b05d. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:55:14 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a193f645-e938-4bcf-9005-f735eedf161f" returned: 0 in 1.817s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-quobyte-a193f645-e938-4bcf-9005-f735eedf161f" released by "delete_volume" :: held 3.611s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Created reservations ['31a8805f-40e9-4bb7-96cc-61246bb1c88f', '4feb46a0-8be1-4b85-b654-4fe96d36c2af', '73192155-6d30-4230-baf4-58ef87c3f102', 'c4efdaf0-6b65-4c3b-ae4c-001300833dbb'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:14 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:55:14 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:14 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" returned: 0 in 6.314s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95bc34f-d69b-407d-bb95-29f3418b3525]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:14 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 Jul 11 18:55:14 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:15 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.816s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Deleted volume successfully. Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4ded24ca-171f-4a0b-bb8a-b3d858bba97e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-a193f645-e938-4bcf-9005-f735eedf161f-delete_volume" released by "delete_volume" :: held 4.898s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "cinder-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "cinder-quobyte-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-quobyte-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d2cb66-efb0-43e4-82d5-2ba70b41dc98]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:15 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc Jul 11 18:55:15 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:15 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" returned: 0 in 1.044s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:55:15 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Converted 1024.00 MB image at 162.14 MB/s Jul 11 18:55:15 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 is being set with open permissions: ugo+rw Jul 11 18:55:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:15 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 Jul 11 18:55:15 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:16 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc" returned: 0 in 0.758s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:16 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc Jul 11 18:55:16 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:16 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" returned: 0 in 0.698s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" released by "_copy_volume_from_snapshot" :: held 9.726s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-ef6ee550-e9a9-404e-bd00-9aafec8e4207-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" released by "_create_volume_from_snapshot" :: held 9.761s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.777s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a235e0-8991-4922-ad98-0da95e5b0c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9', 'volume_size': 1, 'snapshot_id': 'ef6ee550-e9a9-404e-bd00-9aafec8e4207'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b8be74e-217d-41fd-8faf-e565247ee0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:16 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Volume volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 (6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9): created successfully Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b8be74e-217d-41fd-8faf-e565247ee0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Flow 'volume_create_manager' (9cd6b9e1-7eb3-4915-897b-fadf735c4e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:16 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-af5c545c-8a78-4c53-896d-751ca8e907ee tempest-VolumeDependencyTests-1178583818 None] Created volume successfully. Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "cinder-ef6ee550-e9a9-404e-bd00-9aafec8e4207-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-ef6ee550-e9a9-404e-bd00-9aafec8e4207-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "cinder-quobyte-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "cinder-quobyte-ef6ee550-e9a9-404e-bd00-9aafec8e4207" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-ef6ee550-e9a9-404e-bd00-9aafec8e4207" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Deleting offline snapshot ef6ee550-e9a9-404e-bd00-9aafec8e4207 of volume a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:55:16 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] snapshot_file for this snap is: volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc" returned: 0 in 0.728s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc3ed03-1f95-4ae8-8713-4b6c65a4e3a8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-quobyte-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc" released by "delete_volume" :: held 1.547s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Created reservations ['0b026852-5070-4b95-90a6-407875dc8274', '48b73ff3-fdc5-418c-bcc9-6a62ea04edaf', 'bbaa3be6-8981-4a50-8ab3-efae12c583a0', '95efa582-fff9-478a-8be9-7f9482eb7db0'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:17 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 Jul 11 18:55:17 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:17 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:55:17 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:17 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207" returned: 0 in 0.862s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "cinder-75196484-3f29-44f6-8bc0-fc65d4e283a1-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50a67b2-346a-44ac-ba2e-964e2921898e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-75196484-3f29-44f6-8bc0-fc65d4e283a1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "cinder-quobyte-75196484-3f29-44f6-8bc0-fc65d4e283a1" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-quobyte-75196484-3f29-44f6-8bc0-fc65d4e283a1" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[035f7128-6cd2-4070-a85f-7db86d523740]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:17 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 Jul 11 18:55:17 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:18 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.883s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:18 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Deleted volume successfully. Jul 11 18:55:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cbc4bcb-db60-4fbe-b492-758174377c8e tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-f7b7cc19-6e18-44d0-8c7a-399adb9c9edc-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:18 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 Jul 11 18:55:18 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:18 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" returned: 0 in 0.838s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:18 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 Jul 11 18:55:18 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:18 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1" returned: 0 in 0.830s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:18 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1 Jul 11 18:55:18 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:19 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207" returned: 0 in 0.752s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:19 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207 Jul 11 18:55:19 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:19 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-75196484-3f29-44f6-8bc0-fc65d4e283a1" returned: 0 in 0.659s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-quobyte-75196484-3f29-44f6-8bc0-fc65d4e283a1" released by "delete_volume" :: held 1.551s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Created reservations ['8d79c265-c599-4720-bf3c-71a805f74566', '6b6f5f2b-14c9-4ce3-8a94-bab2ccbec7f7', 'eae3e2d9-3ad4-4ac3-a793-6656c6b9d560', '51be2e14-7c97-4240-b7b7-adbf1378d238'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:19 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:55:19 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:20 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25.ef6ee550-e9a9-404e-bd00-9aafec8e4207" returned: 0 in 0.709s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-ef6ee550-e9a9-404e-bd00-9aafec8e4207" released by "_delete_snapshot" :: held 3.309s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" released by "delete_snapshot" :: held 3.336s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Created reservations ['e9075f92-8d75-44ae-b562-93c6b44cf42c', '5b8aa7af-e13e-4fe9-a4d1-aebe547ffb10', '90c3bdb9-6e7c-4df1-8162-37d502929a1c', '622de4cb-7d44-4c1a-b484-364fa136e67f'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:20 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.680s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-21432e14-fc3f-470e-a244-5db35f4361ba req-c3af5cb0-6e17-419b-86ab-a5c005400565 tempest-TestShelveInstance-1461389212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-21432e14-fc3f-470e-a244-5db35f4361ba req-c3af5cb0-6e17-419b-86ab-a5c005400565 tempest-TestShelveInstance-1461389212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Deleted volume successfully. Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[98428f43-0834-4ccf-b8a9-4a7c56bd6f35]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b339db09-7fcf-4423-921c-2458580a9fa1 tempest-AttachVolumeNegativeTest-1126116839 None] Lock "cinder-75196484-3f29-44f6-8bc0-fc65d4e283a1-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-21432e14-fc3f-470e-a244-5db35f4361ba req-c3af5cb0-6e17-419b-86ab-a5c005400565 tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Delete snapshot completed successfully. Jul 11 18:55:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f1512f50-9c7c-4eb7-9bdb-35760c82abaf tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-ef6ee550-e9a9-404e-bd00-9aafec8e4207-delete_snapshot" released by "delete_snapshot" :: held 3.577s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:20 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:55:20 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "cinder-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:21 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-21432e14-fc3f-470e-a244-5db35f4361ba req-c3af5cb0-6e17-419b-86ab-a5c005400565 tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 0 in 0.825s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-21432e14-fc3f-470e-a244-5db35f4361ba req-c3af5cb0-6e17-419b-86ab-a5c005400565 tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "cinder-quobyte-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:21 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[548c1b74-82ff-40c4-b6f5-a702858f0556]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:21 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:55:21 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:21 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 Jul 11 18:55:21 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:22 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-21432e14-fc3f-470e-a244-5db35f4361ba req-c3af5cb0-6e17-419b-86ab-a5c005400565 tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 1 in 0.822s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-21432e14-fc3f-470e-a244-5db35f4361ba req-c3af5cb0-6e17-419b-86ab-a5c005400565 tempest-TestShelveInstance-1461389212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:55:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-21432e14-fc3f-470e-a244-5db35f4361ba req-c3af5cb0-6e17-419b-86ab-a5c005400565 tempest-TestShelveInstance-1461389212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.700s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-21432e14-fc3f-470e-a244-5db35f4361ba req-c3af5cb0-6e17-419b-86ab-a5c005400565 tempest-TestShelveInstance-1461389212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-2700f1dc-05b9-4051-958d-d4987178d34f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a6443ff-7f9a-4817-a234-269f64b87af4', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:55:22 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-21432e14-fc3f-470e-a244-5db35f4361ba req-c3af5cb0-6e17-419b-86ab-a5c005400565 tempest-TestShelveInstance-1461389212 None] attachment_update completed successfully. Jul 11 18:55:22 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" returned: 0 in 0.870s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:22 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25 Jul 11 18:55:22 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:22 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" returned: 0 in 0.687s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25" released by "delete_volume" :: held 1.635s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:22 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Created reservations ['b017b1c2-f91c-4b4b-b0a6-8cadd44605af', 'd2d375f6-624a-48e7-ada8-8c92a07d373d', 'f8399120-2369-4d88-9824-082358770fbc', '1d8242d1-917f-45a8-94fd-52a52b618eaa'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:23 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:55:23 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "cinder-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "cinder-quobyte-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" acquired by "delete_volume" :: waited 0.033s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fac0cf5-026c-40f4-96b9-060e1cff03b7]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:23 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 Jul 11 18:55:23 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:23 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.790s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:23 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Deleted volume successfully. Jul 11 18:55:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-48027861-2114-414f-95a9-a8dc5c76449d tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-a3dc5fb7-6cb3-43ed-843b-f82c7a37fe25-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:24 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" returned: 0 in 0.871s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:24 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9 Jul 11 18:55:24 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:25 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" returned: 0 in 0.696s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-quobyte-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9" released by "delete_volume" :: held 1.635s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Created reservations ['2859f813-4d3c-4c91-aa9b-b86a21e61ead', 'b859c82e-916a-4644-b533-60d60f45d8b9', '2661f4d9-bcaf-482d-a589-b43e640caec8', 'a04a4b69-120c-402b-b448-91ba54dec124'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:25 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:55:25 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:25 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.691s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:25 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Deleted volume successfully. Jul 11 18:55:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b6cff149-1ac3-4fab-9f44-b59a1c94e3ac tempest-VolumeDependencyTests-1178583818 None] Lock "cinder-6dd7f16e-c7d6-4bb7-ad42-04730eeee6b9-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Flow 'volume_create_manager' (bd312d85-c94f-4640-b738-48533c254907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29cf181d-0e2e-480f-8e05-f40d403d1952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29cf181d-0e2e-480f-8e05-f40d403d1952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830864897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0b629d-ec7c-4c80-b635-b7368b5fc979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2a30b62fe54c0aa430c6512e0d78fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:30Z,use_quota=True,user_id='823c54c2532a406a88b5e5189a7e68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9962c41b-69d4-48f0-b3b9-aa0bc75e2f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9962c41b-69d4-48f0-b3b9-aa0bc75e2f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e7c97a-b693-4a92-82fa-f7091f11b916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e7c97a-b693-4a92-82fa-f7091f11b916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0b629d-ec7c-4c80-b635-b7368b5fc979', 'volume_name': 'volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf239e62-4418-45c0-8ec0-bcec5b19e866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf239e62-4418-45c0-8ec0-bcec5b19e866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67c97d9-10f2-44d7-911e-f235b63168f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:29 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Volume 8a0b629d-ec7c-4c80-b635-b7368b5fc979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979', 'volume_size': 1} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830864897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0b629d-ec7c-4c80-b635-b7368b5fc979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2a30b62fe54c0aa430c6512e0d78fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:30Z,use_quota=True,user_id='823c54c2532a406a88b5e5189a7e68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Creating volume 8a0b629d-ec7c-4c80-b635-b7368b5fc979 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:29 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:55:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:30 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979 1073741824 Jul 11 18:55:30 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:30 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979 1073741824" returned: 0 in 0.996s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:31 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979 Jul 11 18:55:31 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:31 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979" returned: 0 in 0.834s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67c97d9-10f2-44d7-911e-f235b63168f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19eccea-6054-4bac-9376-5e59e11c1e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:31 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Volume volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979 (8a0b629d-ec7c-4c80-b635-b7368b5fc979): created successfully Jul 11 18:55:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19eccea-6054-4bac-9376-5e59e11c1e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Flow 'volume_create_manager' (bd312d85-c94f-4640-b738-48533c254907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:31 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a77d434f-08ae-4e39-9313-bc9f9c16d000 tempest-ProjectReaderTests-1720002540 None] Created volume successfully. Jul 11 18:55:32 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-65f013a7-0efa-4108-b6ce-96c3ef494802 tempest-GroupsV314Test-2114463309 None] Group tempest-GroupsV314Test-Group-1701848783: creating Jul 11 18:55:32 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-65f013a7-0efa-4108-b6ce-96c3ef494802 tempest-GroupsV314Test-2114463309 None] Group tempest-GroupsV314Test-Group-1701848783: created successfully Jul 11 18:55:32 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-65f013a7-0efa-4108-b6ce-96c3ef494802 tempest-GroupsV314Test-2114463309 None] Create group completed successfully. Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Acquiring lock "cinder-8a0b629d-ec7c-4c80-b635-b7368b5fc979-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Lock "cinder-8a0b629d-ec7c-4c80-b635-b7368b5fc979-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Acquiring lock "cinder-quobyte-8a0b629d-ec7c-4c80-b635-b7368b5fc979" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Lock "cinder-quobyte-8a0b629d-ec7c-4c80-b635-b7368b5fc979" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[91577213-080b-454c-8ad1-2393c38fc3bd]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:33 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979 Jul 11 18:55:33 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Flow 'volume_create_manager' (f2bf5d84-0aa6-4062-b480-306b633edbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e93e5f-f0a2-4434-8456-c8928dda6f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e93e5f-f0a2-4434-8456-c8928dda6f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-24682289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=229ee1dc-f565-4f49-8124-ee362382e1ab,host='devstack@QuobyteHD#QuobyteHD',id=c5acc7b6-2a04-413c-943d-c07308a73cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b0205ff8c14c2db03996ea446fdc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:34Z,use_quota=True,user_id='34f144db4d214ef0a1b36215904828a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f691b838-758a-4c7b-b524-eca3c4f1cfb7),volume_type_id=f691b838-758a-4c7b-b524-eca3c4f1cfb7)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7c957c-cabd-4cbb-a064-e49be0f47ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7c957c-cabd-4cbb-a064-e49be0f47ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1436d157-4ae9-4db9-8440-3d4959bb58ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1436d157-4ae9-4db9-8440-3d4959bb58ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5acc7b6-2a04-413c-943d-c07308a73cc2', 'volume_name': 'volume-c5acc7b6-2a04-413c-943d-c07308a73cc2', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1e903d-4bb4-47b8-9d75-89664c7a8e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1e903d-4bb4-47b8-9d75-89664c7a8e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1de283-e36d-4eb2-9ca7-1a76cdec29e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:34 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Volume c5acc7b6-2a04-413c-943d-c07308a73cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5acc7b6-2a04-413c-943d-c07308a73cc2', 'volume_size': 1} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=229ee1dc-f565-4f49-8124-ee362382e1ab,created_at=2026-07-11T16:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-24682289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=229ee1dc-f565-4f49-8124-ee362382e1ab,host='devstack@QuobyteHD#QuobyteHD',id=c5acc7b6-2a04-413c-943d-c07308a73cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b0205ff8c14c2db03996ea446fdc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:34Z,use_quota=True,user_id='34f144db4d214ef0a1b36215904828a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f691b838-758a-4c7b-b524-eca3c4f1cfb7),volume_type_id=f691b838-758a-4c7b-b524-eca3c4f1cfb7)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Creating volume c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:34 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:34 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 1073741824 Jul 11 18:55:34 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:34 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979" returned: 0 in 0.994s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:34 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979 Jul 11 18:55:34 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:34 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 1073741824" returned: 0 in 0.868s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:34 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 Jul 11 18:55:34 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:35 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8a0b629d-ec7c-4c80-b635-b7368b5fc979" returned: 0 in 0.817s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Lock "cinder-quobyte-8a0b629d-ec7c-4c80-b635-b7368b5fc979" released by "delete_volume" :: held 1.856s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Created reservations ['5aad018f-d0b5-4f23-9093-fcd44948d3af', '44e84ec3-0f78-44cd-bbb2-2a902f672948', '382a6363-8a23-4f01-8083-1cd68e14bb25', 'd226b2c4-5a5c-44eb-a224-8ce8b5e087ff'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:35 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:55:35 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:35 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2" returned: 0 in 0.990s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1de283-e36d-4eb2-9ca7-1a76cdec29e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5acc7b6-2a04-413c-943d-c07308a73cc2', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491e62bf-647d-4445-924b-329fcaf6985a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:35 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Volume volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 (c5acc7b6-2a04-413c-943d-c07308a73cc2): created successfully Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491e62bf-647d-4445-924b-329fcaf6985a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Flow 'volume_create_manager' (f2bf5d84-0aa6-4062-b480-306b633edbb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6e3be1f8-27e2-4b57-9516-089c640b654a tempest-GroupsV314Test-2114463309 None] Created volume successfully. Jul 11 18:55:36 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.799s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Deleted volume successfully. Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b33e01bb-5d0a-401b-8c02-9bdcbc23dcfa tempest-ProjectReaderTests-1720002540 None] Lock "cinder-8a0b629d-ec7c-4c80-b635-b7368b5fc979-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Flow 'volume_create_manager' (ea521f6f-863b-44d5-94a8-8ed086487907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3998d2-34e5-4467-ad3b-743f3a0043e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3998d2-34e5-4467-ad3b-743f3a0043e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1111252464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f61214-bd1f-4a06-bcce-e4b87e1f7bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2a30b62fe54c0aa430c6512e0d78fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:36Z,use_quota=True,user_id='823c54c2532a406a88b5e5189a7e68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3932768b-52d3-4fa0-94fc-12da7a5efef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3932768b-52d3-4fa0-94fc-12da7a5efef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1a2314-9294-423b-8823-49fdfdab4bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1a2314-9294-423b-8823-49fdfdab4bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f61214-bd1f-4a06-bcce-e4b87e1f7bb6', 'volume_name': 'volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954f5c41-b8ec-472e-86d2-7beb164a9f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954f5c41-b8ec-472e-86d2-7beb164a9f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7515e9-e8b5-4d55-b7f4-1e513398dbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:36 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Volume 50f61214-bd1f-4a06-bcce-e4b87e1f7bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6', 'volume_size': 1} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1111252464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f61214-bd1f-4a06-bcce-e4b87e1f7bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2a30b62fe54c0aa430c6512e0d78fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:55:36Z,use_quota=True,user_id='823c54c2532a406a88b5e5189a7e68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Creating volume 50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:55:36 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:55:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:36 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 1073741824 Jul 11 18:55:36 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:37 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 1073741824" returned: 0 in 0.897s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:37 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 Jul 11 18:55:37 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:37 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6" returned: 0 in 0.722s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:55:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.500s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:37 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Cloning volume c5acc7b6-2a04-413c-943d-c07308a73cc2 to volume 135ffde6-1b3d-4ba7-9b2d-29a827e755dd Jul 11 18:55:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7515e9-e8b5-4d55-b7f4-1e513398dbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc776ad-50f1-471e-8764-4f11331c1496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:55:38 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Volume volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 (50f61214-bd1f-4a06-bcce-e4b87e1f7bb6): created successfully Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc776ad-50f1-471e-8764-4f11331c1496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Flow 'volume_create_manager' (ea521f6f-863b-44d5-94a8-8ed086487907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Creating offline snapshot f8ae0711-a69d-4c1f-bd7e-0b962e735f8b of volume c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:55:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-07e7ad10-1b8e-497e-9186-645d2cf52033 tempest-ProjectReaderTests-1720002540 None] Created volume successfully. Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b6001b-2916-4408-b61d-58935f44946d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:38 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 Jul 11 18:55:38 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Acquiring lock "cinder-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Lock "cinder-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Acquiring lock "cinder-quobyte-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Lock "cinder-quobyte-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24d8134-62a3-4cd7-8f21-ab162927c492]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:38 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 Jul 11 18:55:38 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:38 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2" returned: 0 in 0.837s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:38 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b 1G Jul 11 18:55:38 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:39 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6" returned: 0 in 0.803s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:39 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6 Jul 11 18:55:39 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:39 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b 1G" returned: 0 in 0.858s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:39 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b Jul 11 18:55:39 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:39 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6" returned: 0 in 0.667s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Lock "cinder-quobyte-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6" released by "delete_volume" :: held 1.518s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:39 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Created reservations ['d310efa0-b1c7-47d8-a57e-dcc7ae3e1c7c', 'af19ec14-9be0-4b37-b45e-144ed9fc8555', '7696b688-b44f-48a2-b084-90093178c295', 'dcbe70a6-7cf1-4c01-b7b0-8ddc62203939'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:40 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:55:40 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:40 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b" returned: 0 in 0.730s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:40 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:40 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b Jul 11 18:55:40 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:40 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.746s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Deleted volume successfully. Jul 11 18:55:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-782c4523-c885-4081-92e6-0ba7a804cc66 tempest-ProjectReaderTests-1720002540 None] Lock "cinder-50f61214-bd1f-4a06-bcce-e4b87e1f7bb6-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:41 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b" returned: 0 in 0.741s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:41 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.info Jul 11 18:55:41 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:42 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.info" returned: 0 in 0.783s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:42 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:42 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.info Jul 11 18:55:42 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:42 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.info" returned: 0 in 0.641s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Acquiring lock "cinder-quobyte-135ffde6-1b3d-4ba7-9b2d-29a827e755dd" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Lock "cinder-quobyte-135ffde6-1b3d-4ba7-9b2d-29a827e755dd" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] snapshot: f8ae0711-a69d-4c1f-bd7e-0b962e735f8b, volume: 135ffde6-1b3d-4ba7-9b2d-29a827e755dd, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a8e9ca-602d-4e87-8585-27044378b33e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:42 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b Jul 11 18:55:42 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:43 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b" returned: 0 in 0.754s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5acc7b6-2a04-413c-943d-c07308a73cc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:55:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 18:55:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 18:55:43 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f46a6e-235f-41a2-a000-bdc28b0a68c0]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:43 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 Jul 11 18:55:43 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:44 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2" returned: 0 in 0.770s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:44 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 18:55:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:44 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd Jul 11 18:55:44 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:49 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd" returned: 0 in 5.320s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:49 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ce10d5-18fd-43a0-9d87-4ddfbba6f5ea]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:49 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 Jul 11 18:55:49 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:50 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2" returned: 0 in 0.903s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:50 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:55:50 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Converted 1024.00 MB image at 192.43 MB/s Jul 11 18:55:50 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd is being set with open permissions: ugo+rw: NotImplementedError Jul 11 18:55:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:50 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd Jul 11 18:55:50 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:51 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd" returned: 0 in 0.627s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Lock "cinder-quobyte-135ffde6-1b3d-4ba7-9b2d-29a827e755dd" released by "_copy_volume_from_snapshot" :: held 8.458s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Acquiring lock "cinder-quobyte-f8ae0711-a69d-4c1f-bd7e-0b962e735f8b" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Lock "cinder-quobyte-f8ae0711-a69d-4c1f-bd7e-0b962e735f8b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Deleting offline snapshot f8ae0711-a69d-4c1f-bd7e-0b962e735f8b of volume c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] snapshot_file for this snap is: volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b9e709-5609-45ca-99bb-579c56e5ad12]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=61,cinder:DELETE=7,cinder:INSERT=20,cinder:UPDATE=66 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:55:51 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b Jul 11 18:55:51 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:51 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:55:51 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:52 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b" returned: 0 in 0.752s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5acc7b6-2a04-413c-943d-c07308a73cc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:55:52 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.629s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b77b4d-79ed-4141-bfec-0fb7a69098d1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:52 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 Jul 11 18:55:52 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:52 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2" returned: 0 in 0.771s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:52 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b Jul 11 18:55:52 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:53 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b" returned: 0 in 0.712s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:53 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b Jul 11 18:55:53 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:54 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2.f8ae0711-a69d-4c1f-bd7e-0b962e735f8b" returned: 0 in 0.646s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Lock "cinder-quobyte-f8ae0711-a69d-4c1f-bd7e-0b962e735f8b" released by "_delete_snapshot" :: held 2.963s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.271s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:54 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-70c57a30-7a7b-40e8-90f6-bc12dfe93798 tempest-GroupsV314Test-2114463309 None] Create group from source-group-229ee1dc-f565-4f49-8124-ee362382e1ab completed successfully. Jul 11 18:55:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Acquiring lock "cinder-quobyte-135ffde6-1b3d-4ba7-9b2d-29a827e755dd" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Lock "cinder-quobyte-135ffde6-1b3d-4ba7-9b2d-29a827e755dd" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:55 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afb5f1f-cfb3-4e1f-884d-40931162e8d5]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:55 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd Jul 11 18:55:55 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:56 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd" returned: 0 in 0.749s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:56 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd Jul 11 18:55:56 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:56 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-135ffde6-1b3d-4ba7-9b2d-29a827e755dd" returned: 0 in 0.622s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Lock "cinder-quobyte-135ffde6-1b3d-4ba7-9b2d-29a827e755dd" released by "delete_volume" :: held 1.421s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:56 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Created reservations ['3483b321-3077-4420-b42d-66afc94ee4d5'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:56 devstack cinder-volume[87411]: WARNING cinder.quota [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1203043087 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1203043087, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:55:56 devstack cinder-volume[87411]: WARNING cinder.quota [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1203043087 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1203043087, it is now deprecated. Please use the default quota class for default quota. Jul 11 18:55:56 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Created reservations ['c5cf1a7f-75b1-4b4c-a056-2435afc3d1e9', 'ab2b50e8-8687-41ee-9693-49126fbdfb97', '5d8f61c3-2d2a-4b8f-a7f7-19d67f09042d', '6bb74723-d2b6-4154-949d-8ac3435f4bf9'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:57 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:55:57 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:57 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.657s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:57 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:55:57 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-21f37e13-8061-4835-92a9-f1b288353266 tempest-GroupsV314Test-2114463309 None] Delete group completed successfully. Jul 11 18:55:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Acquiring lock "cinder-quobyte-c5acc7b6-2a04-413c-943d-c07308a73cc2" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:55:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Lock "cinder-quobyte-c5acc7b6-2a04-413c-943d-c07308a73cc2" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:55:58 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe9f71e-6de1-404d-8a6e-73408f9592f8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:55:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:58 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 Jul 11 18:55:58 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:58 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2" returned: 0 in 0.823s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:58 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2 Jul 11 18:55:58 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:55:59 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 11 18:55:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c5acc7b6-2a04-413c-943d-c07308a73cc2" returned: 0 in 0.651s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:55:59 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Lock "cinder-quobyte-c5acc7b6-2a04-413c-943d-c07308a73cc2" released by "delete_volume" :: held 1.561s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:55:59 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Created reservations ['ddfe1fce-4b0a-4000-b314-eba7b1263b93'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:59 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Created reservations ['f5a07878-1847-46b0-8650-b49ec5cfa197', '6330129d-1ac4-492e-9d96-dc1342968b0b', '28047696-18c5-46c0-a8d7-186a634ac0ed', 'd296c684-dd1b-44a1-bde1-e1f171126d81'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:55:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:55:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:55:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:55:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:55:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:55:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:55:59 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:55:59 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:00 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.805s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:00 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:00 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2f01416d-1605-434c-9aae-0297126dcb70 tempest-GroupsV314Test-2114463309 None] Delete group completed successfully. Jul 11 18:56:02 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-e0f42cc0-6ade-4d98-841a-5037d416ceb9 tempest-TestShelveInstance-1461389212 None] Terminate volume connection completed successfully. Jul 11 18:56:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-e0f42cc0-6ade-4d98-841a-5037d416ceb9 tempest-TestShelveInstance-1461389212 None] Deleting attachment 6a6443ff-7f9a-4817-a234-269f64b87af4. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:56:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Acquiring lock "cinder-2700f1dc-05b9-4051-958d-d4987178d34f-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Lock "cinder-2700f1dc-05b9-4051-958d-d4987178d34f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Acquiring lock "cinder-quobyte-2700f1dc-05b9-4051-958d-d4987178d34f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Lock "cinder-quobyte-2700f1dc-05b9-4051-958d-d4987178d34f" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:03 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaca5d6-307c-4b2c-8d1c-a99d144519e9]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:03 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:56:03 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:04 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 0 in 0.756s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:04 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:56:04 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:05 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 1 in 0.742s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:05 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f Jul 11 18:56:05 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:05 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2700f1dc-05b9-4051-958d-d4987178d34f" returned: 0 in 0.674s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Lock "cinder-quobyte-2700f1dc-05b9-4051-958d-d4987178d34f" released by "delete_volume" :: held 2.265s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=92,cinder:UPDATE=114,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG cinder.quota [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Created reservations ['c3e7862f-fc5d-4b07-bf64-d4af72e3faf1', 'b5e7548b-61e3-41fb-930c-812f9be58846', 'a61ca856-bc79-43ac-85ef-0fb80d299819', '74a32d86-f855-4e66-b482-117018b539e8'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:05 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:05 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:06 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.675s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:06 devstack cinder-volume[87411]: DEBUG cinder.manager [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:06 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Deleted volume successfully. Jul 11 18:56:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [req-04696641-76bf-4a1c-9ac8-b89e7ddcf901 req-67ce4b4b-41d4-4644-88b6-e25291023928 tempest-TestShelveInstance-1461389212 None] Lock "cinder-2700f1dc-05b9-4051-958d-d4987178d34f-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Flow 'volume_create_manager' (fac270e2-5ba2-425a-9a68-86e63c0e6736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b79529a-f56e-4fc5-971d-17f561b440d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b79529a-f56e-4fc5-971d-17f561b440d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1832692136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ba0f00-7115-4ece-b1ac-b0d52db00a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ae3e1696254e4fa8b7422f410cf180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:13Z,use_quota=True,user_id='317e36c3bdde45f8aadf751f0ab7f405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a544ecc7-f064-4fa8-b038-02539f0c47bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a544ecc7-f064-4fa8-b038-02539f0c47bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6454b9f6-3db4-43c2-91df-ae507f1b4ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6454b9f6-3db4-43c2-91df-ae507f1b4ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ba0f00-7115-4ece-b1ac-b0d52db00a8c', 'volume_name': 'volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e347d361-5640-4ddd-9311-2c1b9f58dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e347d361-5640-4ddd-9311-2c1b9f58dc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114d948c-78b1-42f4-b36b-9680ea065cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:13 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Volume 17ba0f00-7115-4ece-b1ac-b0d52db00a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c', 'volume_size': 1} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1832692136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ba0f00-7115-4ece-b1ac-b0d52db00a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ae3e1696254e4fa8b7422f410cf180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:13Z,use_quota=True,user_id='317e36c3bdde45f8aadf751f0ab7f405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Creating volume 17ba0f00-7115-4ece-b1ac-b0d52db00a8c {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:13 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:56:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:13 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c 1073741824 Jul 11 18:56:13 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:14 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c 1073741824" returned: 0 in 0.850s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:14 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c Jul 11 18:56:14 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:15 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c" returned: 0 in 0.643s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114d948c-78b1-42f4-b36b-9680ea065cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9415505-24ce-4238-a64f-aa138e39824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Volume volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c (17ba0f00-7115-4ece-b1ac-b0d52db00a8c): created successfully Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9415505-24ce-4238-a64f-aa138e39824c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Flow 'volume_create_manager' (fac270e2-5ba2-425a-9a68-86e63c0e6736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2a07782b-65f3-43d2-8d8f-c24edab07a12 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Created volume successfully. Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Acquiring lock "cinder-17ba0f00-7115-4ece-b1ac-b0d52db00a8c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "cinder-17ba0f00-7115-4ece-b1ac-b0d52db00a8c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Acquiring lock "cinder-quobyte-17ba0f00-7115-4ece-b1ac-b0d52db00a8c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "cinder-quobyte-17ba0f00-7115-4ece-b1ac-b0d52db00a8c" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6be85e0-1456-4564-81c1-52edfe185eac]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:15 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c Jul 11 18:56:15 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:16 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c" returned: 0 in 0.783s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:16 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c Jul 11 18:56:16 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:17 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-17ba0f00-7115-4ece-b1ac-b0d52db00a8c" returned: 0 in 0.682s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "cinder-quobyte-17ba0f00-7115-4ece-b1ac-b0d52db00a8c" released by "delete_volume" :: held 1.510s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Created reservations ['6c166afb-5636-41b7-a868-875371708dea', 'aa4dc564-4454-4a0e-b6ea-df5648ff68f2', 'fad10209-76b7-47f3-b0f2-a0b9949b1bdb', 'fdf31d04-77c7-4a16-b4a3-e66e8c60a487'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:17 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:17 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:17 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.674s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:17 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Deleted volume successfully. Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-805909fd-cb13-4f9e-87b0-370428882838 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "cinder-17ba0f00-7115-4ece-b1ac-b0d52db00a8c-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Flow 'volume_create_manager' (b4ac79d0-ea80-4bb7-a717-f24f73c6f849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc71376c-83a8-4f3d-9c74-0de7611c10e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc71376c-83a8-4f3d-9c74-0de7611c10e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-950620085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ae3e1696254e4fa8b7422f410cf180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:18Z,use_quota=True,user_id='317e36c3bdde45f8aadf751f0ab7f405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4a2e35-151b-4257-b61a-43ced73a80bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4a2e35-151b-4257-b61a-43ced73a80bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03199b7-512d-47bd-9dcf-400b489c6007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03199b7-512d-47bd-9dcf-400b489c6007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e', 'volume_name': 'volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f34c8bf-b23c-42dd-a57d-e204b69af78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f34c8bf-b23c-42dd-a57d-e204b69af78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf2d6b0-8e17-4966-89ea-dbcce022e68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:18 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Volume 0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e', 'volume_size': 1} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-950620085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ae3e1696254e4fa8b7422f410cf180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:18Z,use_quota=True,user_id='317e36c3bdde45f8aadf751f0ab7f405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Creating volume 0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:18 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:56:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:18 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e 1073741824 Jul 11 18:56:18 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:19 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e 1073741824" returned: 0 in 0.871s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:19 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e Jul 11 18:56:19 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Flow 'volume_create_manager' (33f5f07e-d2ba-46f9-83be-168ed15eb97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565c8bdf-2f16-413b-a497-bfce51980be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565c8bdf-2f16-413b-a497-bfce51980be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58002320-b1b1-4cf8-bb7b-a0a783280ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8d212838984084ac8a969944b099f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:19Z,use_quota=True,user_id='d06b9e2847ee4000b21deff3a97ec255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50297bbf-ddc3-4fd8-b945-0b25e3c97c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50297bbf-ddc3-4fd8-b945-0b25e3c97c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be68c62b-4a4c-4880-90de-62dcc8275e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.image.glance [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Creating Keystone auth plugin from conf {{(pid=87411) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be68c62b-4a4c-4880-90de-62dcc8275e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58002320-b1b1-4cf8-bb7b-a0a783280ab7', 'volume_name': 'volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7', 'volume_size': 1, 'image_id': '5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f35249e679014e7aa8edb8bb0cb83cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f8d212838984084ac8a969944b099f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f79638a846d4ed3f695c4dd29f56a0db7bd39526627442d60742307d98601c62a0da73ca7d5117052b61952db539446b0369054548eb617c3b91e449cfb7a2e6', 'id': '5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'created_at': datetime.datetime(2026, 7, 11, 16, 56, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 56, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f37cd87-5b10-46ae-9501-fcd9d1d99925/file', 'properties': {}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d495e83f-227e-49f5-a598-ae1dbaf4d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d495e83f-227e-49f5-a598-ae1dbaf4d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006c03ef-f560-405e-8356-e1488bf3796a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:19 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Volume 58002320-b1b1-4cf8-bb7b-a0a783280ab7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7', 'volume_size': 1, 'image_id': '5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f35249e679014e7aa8edb8bb0cb83cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f8d212838984084ac8a969944b099f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f79638a846d4ed3f695c4dd29f56a0db7bd39526627442d60742307d98601c62a0da73ca7d5117052b61952db539446b0369054548eb617c3b91e449cfb7a2e6', 'id': '5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'created_at': datetime.datetime(2026, 7, 11, 16, 56, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 56, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f37cd87-5b10-46ae-9501-fcd9d1d99925/file', 'properties': {}}, 'image_service': } Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Trying to clone 58002320-b1b1-4cf8-bb7b-a0a783280ab7 from image 5f37cd87-5b10-46ae-9501-fcd9d1d99925 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'metadata': {}}]). {{(pid=87411) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 18:56:19 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Image download 0.00 MB at 0.00 MB/s Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4419f4a-e450-442e-ab14-81bbd5fcdeea]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:19 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD Jul 11 18:56:19 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:20 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e" returned: 0 in 0.647s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf2d6b0-8e17-4966-89ea-dbcce022e68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0fc096-9daa-4299-a67d-a7c38fadc903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:20 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Volume volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e (0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e): created successfully Jul 11 18:56:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0fc096-9daa-4299-a67d-a7c38fadc903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Flow 'volume_create_manager' (b4ac79d0-ea80-4bb7-a717-f24f73c6f849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9729f67d-ec8d-4654-9e0f-6c7d45e849a6 tempest-VolumeQuotasAdminTestJSON-1117917417 None] Created volume successfully. Jul 11 18:56:20 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:20 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD Jul 11 18:56:20 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:21 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e82a0eae-a022-401a-8e02-67860fb47c4f tempest-VolumeQuotasAdminTestJSON-1238913571 None] Transfer volume completed successfully. Jul 11 18:56:21 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:56:21 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Temporary image 5f37cd87-5b10-46ae-9501-fcd9d1d99925 is fetched for user d06b9e2847ee4000b21deff3a97ec255. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 18:56:21 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef785505-6fc2-4a7c-a941-0ea5c1fc445c]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:21 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD Jul 11 18:56:21 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Acquiring lock "cinder-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Lock "cinder-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Acquiring lock "cinder-quobyte-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:22 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Lock "cinder-quobyte-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51c9cdf-b3c1-417c-a73f-2cf2cb832968]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:22 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD Jul 11 18:56:22 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:22 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e Jul 11 18:56:22 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:22 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD" returned: 1 in 0.752s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58002320-b1b1-4cf8-bb7b-a0a783280ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8d212838984084ac8a969944b099f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:19Z,use_quota=True,user_id='d06b9e2847ee4000b21deff3a97ec255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Creating volume 58002320-b1b1-4cf8-bb7b-a0a783280ab7 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:22 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:22 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e" returned: 0 in 0.760s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:22 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 1073741824 Jul 11 18:56:22 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:22 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e Jul 11 18:56:22 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:23 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e" returned: 0 in 0.651s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Lock "cinder-quobyte-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e" released by "delete_volume" :: held 1.458s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Created reservations ['b74cfff5-6196-4209-85e8-18676f2aacc6', '4d71c81c-83a3-4903-9c92-9016f33a6326', '3e8eac24-dce0-49bb-a8e3-42b9177b4f6f', 'bf2c418e-3ce2-4ae1-b8e7-810cccfa54fe'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:23 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:23 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:23 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 1073741824" returned: 0 in 0.838s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:23 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 Jul 11 18:56:23 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:24 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.653s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:24 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Deleted volume successfully. Jul 11 18:56:24 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7" returned: 0 in 0.628s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46af86d1-142c-4eab-b826-3642e0562810 tempest-VolumeQuotasAdminTestJSON-1363795926 None] Lock "cinder-0cb0d70c-6de3-4eeb-9f36-f2282f34cb4e-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:24 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Attempting download of 5f37cd87-5b10-46ae-9501-fcd9d1d99925 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'metadata': {}}])) to volume 58002320-b1b1-4cf8-bb7b-a0a783280ab7. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 18:56:24 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2c7953-75bb-4422-99e7-35f9ccbce40d]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f37cd87-5b10-46ae-9501-fcd9d1d99925_tz0w3t0l {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:24 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f37cd87-5b10-46ae-9501-fcd9d1d99925_tz0w3t0l Jul 11 18:56:24 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:25 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5f37cd87-5b10-46ae-9501-fcd9d1d99925_tz0w3t0l" returned: 0 in 0.736s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f37cd87-5b10-46ae-9501-fcd9d1d99925_tz0w3t0l {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:25 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f37cd87-5b10-46ae-9501-fcd9d1d99925_tz0w3t0l Jul 11 18:56:25 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:25 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f37cd87-5b10-46ae-9501-fcd9d1d99925_tz0w3t0l" returned: 1 in 0.746s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5f37cd87-5b10-46ae-9501-fcd9d1d99925_tz0w3t0l' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:56:25 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65ff301-6bb0-4442-8eb0-840a13a0ba6a]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:26 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD Jul 11 18:56:26 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:26 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:26 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD Jul 11 18:56:26 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:27 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD" returned: 1 in 0.748s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:56:27 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] 5f37cd87-5b10-46ae-9501-fcd9d1d99925 was raw, converting to raw {{(pid=87411) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 18:56:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:27 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 Jul 11 18:56:27 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:28 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7" returned: 0 in 0.760s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:28 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5f37cd87-5b10-46ae-9501-fcd9d1d99925_bjxz25fzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 18:56:28 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 18:56:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:28 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 1G Jul 11 18:56:28 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:29 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 1G" returned: 0 in 0.727s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3843bb1-c02e-4f7d-9bec-305b5462ba49]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:29 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 Jul 11 18:56:29 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:29 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7" returned: 0 in 0.753s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Flow 'volume_create_manager' (5cd61d8c-ece3-4621-addc-6fcd598f045b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d2828a-e5c5-417e-ad37-36db9a3ef528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d2828a-e5c5-417e-ad37-36db9a3ef528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-50441714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a056ac3-121b-41fe-93ed-0c7fd49ad0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603255bc5698425ea2287241a2c211ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:30Z,use_quota=True,user_id='4d0e3534a154401fa977cc5d1d187d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02197e87-1e04-494e-8a21-1c719745f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02197e87-1e04-494e-8a21-1c719745f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8097c6-b5e0-4049-a434-e4de1b7986e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8097c6-b5e0-4049-a434-e4de1b7986e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a056ac3-121b-41fe-93ed-0c7fd49ad0ea', 'volume_name': 'volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf15580-89d0-4e63-9be4-92681bc5f11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf15580-89d0-4e63-9be4-92681bc5f11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90d641b-4035-497b-b448-65d856d46678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:29 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Volume 2a056ac3-121b-41fe-93ed-0c7fd49ad0ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea', 'volume_size': 1} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-50441714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a056ac3-121b-41fe-93ed-0c7fd49ad0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603255bc5698425ea2287241a2c211ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:30Z,use_quota=True,user_id='4d0e3534a154401fa977cc5d1d187d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Creating volume 2a056ac3-121b-41fe-93ed-0c7fd49ad0ea {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:29 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 Jul 11 18:56:29 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:29 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:56:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:29 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea 1073741824 Jul 11 18:56:29 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:30 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7" returned: 1 in 0.801s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Downloaded image 5f37cd87-5b10-46ae-9501-fcd9d1d99925 ((None, [{'url': 'file:///opt/stack/data/glance/images/5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'metadata': {}}])) to volume 58002320-b1b1-4cf8-bb7b-a0a783280ab7 successfully. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Temporary image 5f37cd87-5b10-46ae-9501-fcd9d1d99925 for user d06b9e2847ee4000b21deff3a97ec255 is deleted. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Marking volume 58002320-b1b1-4cf8-bb7b-a0a783280ab7 as bootable. {{(pid=87411) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Copying metadata from image 5f37cd87-5b10-46ae-9501-fcd9d1d99925 to 58002320-b1b1-4cf8-bb7b-a0a783280ab7. {{(pid=87411) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Creating volume glance metadata for volume 58002320-b1b1-4cf8-bb7b-a0a783280ab7 backed by image 5f37cd87-5b10-46ae-9501-fcd9d1d99925 with: {'image_id': '5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3f35249e679014e7aa8edb8bb0cb83cf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87411) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006c03ef-f560-405e-8356-e1488bf3796a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7', 'volume_size': 1, 'image_id': '5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f35249e679014e7aa8edb8bb0cb83cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f8d212838984084ac8a969944b099f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f79638a846d4ed3f695c4dd29f56a0db7bd39526627442d60742307d98601c62a0da73ca7d5117052b61952db539446b0369054548eb617c3b91e449cfb7a2e6', 'id': '5f37cd87-5b10-46ae-9501-fcd9d1d99925', 'created_at': datetime.datetime(2026, 7, 11, 16, 56, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 16, 56, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5f37cd87-5b10-46ae-9501-fcd9d1d99925/file', 'properties': {}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771660aa-2c31-4125-ac58-3960c30ac4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:30 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Volume volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 (58002320-b1b1-4cf8-bb7b-a0a783280ab7): created successfully Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771660aa-2c31-4125-ac58-3960c30ac4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Flow 'volume_create_manager' (33f5f07e-d2ba-46f9-83be-168ed15eb97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:30 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e669303c-a256-4c79-9392-739a66a33850 tempest-VolumeImageDependencyTests-1131509111 None] Created volume successfully. Jul 11 18:56:30 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea 1073741824" returned: 0 in 0.856s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:30 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea Jul 11 18:56:30 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Acquiring lock "cinder-58002320-b1b1-4cf8-bb7b-a0a783280ab7-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Lock "cinder-58002320-b1b1-4cf8-bb7b-a0a783280ab7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Acquiring lock "cinder-quobyte-58002320-b1b1-4cf8-bb7b-a0a783280ab7" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Lock "cinder-quobyte-58002320-b1b1-4cf8-bb7b-a0a783280ab7" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca8f8ea-3e66-4155-a388-7494444baf2f]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:31 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 Jul 11 18:56:31 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:31 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" returned: 0 in 0.649s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90d641b-4035-497b-b448-65d856d46678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1eba2c5-1868-40a9-9238-98c3cdf0b64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:31 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Volume volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea (2a056ac3-121b-41fe-93ed-0c7fd49ad0ea): created successfully Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1eba2c5-1868-40a9-9238-98c3cdf0b64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Flow 'volume_create_manager' (5cd61d8c-ece3-4621-addc-6fcd598f045b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:31 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d4696247-bf7d-411d-a447-cca3b4c5979b tempest-SnapshotMetadataTestJSON-1671777231 None] Created volume successfully. Jul 11 18:56:31 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7" returned: 0 in 0.765s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Creating offline snapshot 62fc1bac-0884-4ff4-8870-ef911ef92f27 of volume 2a056ac3-121b-41fe-93ed-0c7fd49ad0ea {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:56:32 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e938e75-074a-4e88-9fa9-2620a9b59243]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:32 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 Jul 11 18:56:32 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:32 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea Jul 11 18:56:32 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:32 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7" returned: 1 in 0.749s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 18:56:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:32 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7 Jul 11 18:56:32 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:32 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" returned: 0 in 0.776s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:32 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 1G Jul 11 18:56:32 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:33 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58002320-b1b1-4cf8-bb7b-a0a783280ab7" returned: 0 in 0.651s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Lock "cinder-quobyte-58002320-b1b1-4cf8-bb7b-a0a783280ab7" released by "delete_volume" :: held 2.226s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Created reservations ['0d464c05-87b7-4af9-b345-43687e2d2452', '19d69b73-3b55-4f18-a050-1ae5f7701d9d', '02e187ef-e142-406e-bc43-aad22751dfe5', '8022181f-126a-41da-a336-8e143f3f3bc1'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:33 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:33 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:33 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 1G" returned: 0 in 0.817s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:33 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 Jul 11 18:56:33 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:34 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.645s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:34 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:34 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Deleted volume successfully. Jul 11 18:56:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5ad521b4-0e3c-4b3e-99a1-c9ad93865e38 tempest-VolumeImageDependencyTests-1131509111 None] Lock "cinder-58002320-b1b1-4cf8-bb7b-a0a783280ab7-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:34 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27" returned: 0 in 0.693s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:34 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 is being set with open permissions: ugo+rw Jul 11 18:56:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:34 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 Jul 11 18:56:34 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:35 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27" returned: 0 in 0.659s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:35 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.info Jul 11 18:56:35 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:35 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.info" returned: 0 in 0.686s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:35 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.info is being set with open permissions: ugo+rw Jul 11 18:56:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:35 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.info Jul 11 18:56:35 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:36 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.info" returned: 0 in 0.680s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.402s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-089381bc-8721-417d-ac60-548e59c0f0bc tempest-SnapshotMetadataTestJSON-1671777231 None] Create snapshot completed successfully Jul 11 18:56:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Acquiring lock "cinder-62fc1bac-0884-4ff4-8870-ef911ef92f27-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "cinder-62fc1bac-0884-4ff4-8870-ef911ef92f27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Acquiring lock "cinder-quobyte-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "cinder-quobyte-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Acquiring lock "cinder-quobyte-62fc1bac-0884-4ff4-8870-ef911ef92f27" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "cinder-quobyte-62fc1bac-0884-4ff4-8870-ef911ef92f27" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Deleting offline snapshot 62fc1bac-0884-4ff4-8870-ef911ef92f27 of volume 2a056ac3-121b-41fe-93ed-0c7fd49ad0ea {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] snapshot_file for this snap is: volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab02a8b-7480-4152-b9ee-0a4e3d87a920]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Flow 'volume_create_manager' (7e46f48d-cc93-4883-90de-8eb84aa4a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc2660e-36ff-4c3d-99f0-07b81989a506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc2660e-36ff-4c3d-99f0-07b81989a506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361413824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0902871e-266c-4a40-8754-934b20bcd97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d77a8365fcb479997dafc3741b2bb27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:38Z,use_quota=True,user_id='8fc3b7b14a9043da89ff535bdeeb1ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761851ca-f589-4733-804b-849d17a0067d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761851ca-f589-4733-804b-849d17a0067d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45610254-d970-49d3-8a71-6620080ba1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45610254-d970-49d3-8a71-6620080ba1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0902871e-266c-4a40-8754-934b20bcd97d', 'volume_name': 'volume-0902871e-266c-4a40-8754-934b20bcd97d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c2be33-7749-49b2-9890-93d0cd601deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c2be33-7749-49b2-9890-93d0cd601deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4760be18-d818-4623-b132-193b1ebf42f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:38 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Volume 0902871e-266c-4a40-8754-934b20bcd97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0902871e-266c-4a40-8754-934b20bcd97d', 'volume_size': 1} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361413824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0902871e-266c-4a40-8754-934b20bcd97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d77a8365fcb479997dafc3741b2bb27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:38Z,use_quota=True,user_id='8fc3b7b14a9043da89ff535bdeeb1ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Creating volume 0902871e-266c-4a40-8754-934b20bcd97d {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:38 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:38 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:38 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:38 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d 1073741824 Jul 11 18:56:38 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:38 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27" returned: 0 in 0.786s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3e1d13-a98f-413d-8202-551aee635a15]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:38 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea Jul 11 18:56:38 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:39 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d 1073741824" returned: 0 in 0.855s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:39 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d Jul 11 18:56:39 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:39 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" returned: 0 in 0.775s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:39 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 Jul 11 18:56:39 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:39 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d" returned: 0 in 0.653s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4760be18-d818-4623-b132-193b1ebf42f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0902871e-266c-4a40-8754-934b20bcd97d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2a864f-246b-4b16-8faf-09cc00d89aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:39 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Volume volume-0902871e-266c-4a40-8754-934b20bcd97d (0902871e-266c-4a40-8754-934b20bcd97d): created successfully Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2a864f-246b-4b16-8faf-09cc00d89aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Flow 'volume_create_manager' (7e46f48d-cc93-4883-90de-8eb84aa4a909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:39 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5f80d98b-a6c2-4765-b50b-0e9385e7d262 tempest-ProjectReaderTests-1435520402 None] Created volume successfully. Jul 11 18:56:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "cinder-0902871e-266c-4a40-8754-934b20bcd97d-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-0902871e-266c-4a40-8754-934b20bcd97d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "cinder-quobyte-0902871e-266c-4a40-8754-934b20bcd97d" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-quobyte-0902871e-266c-4a40-8754-934b20bcd97d" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:40 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf093f4-804d-480e-9d63-ff6b251a6b6b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:40 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27" returned: 0 in 0.798s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:40 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27 Jul 11 18:56:40 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:40 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d Jul 11 18:56:40 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:41 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea.62fc1bac-0884-4ff4-8870-ef911ef92f27" returned: 0 in 0.655s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "cinder-quobyte-62fc1bac-0884-4ff4-8870-ef911ef92f27" released by "_delete_snapshot" :: held 3.127s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "cinder-quobyte-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" released by "delete_snapshot" :: held 3.153s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:41 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Created reservations ['a1bd11db-fc98-4711-8484-e81d09120511', '08868529-0084-46ac-a3ff-39f152b40818', '679b2d1e-3c47-45d6-b695-eea3e4f2dc33', 'f560f146-4e05-4d72-a547-333d797ece33'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d" returned: 0 in 0.812s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:41 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d Jul 11 18:56:41 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:41 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Delete snapshot completed successfully. Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c2e4ff26-dbb4-4dd3-86c2-37cd420b0e3b tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "cinder-62fc1bac-0884-4ff4-8870-ef911ef92f27-delete_snapshot" released by "delete_snapshot" :: held 3.312s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:41 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0902871e-266c-4a40-8754-934b20bcd97d" returned: 0 in 0.664s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-quobyte-0902871e-266c-4a40-8754-934b20bcd97d" released by "delete_volume" :: held 1.516s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Created reservations ['a13eff3f-de1f-4981-911b-40564bef9cf1', '64baf375-2467-4eff-a70f-4a4a4d91d598', '79eb15b4-a430-4d5a-95a5-f17e73d56edc', '3ce276a1-c458-48a2-9efe-b29036982374'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:42 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:42 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Acquiring lock "cinder-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "cinder-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Acquiring lock "cinder-quobyte-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "cinder-quobyte-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ec8a28-a64c-43dd-84c3-ef591209471e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:42 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea Jul 11 18:56:42 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:42 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.661s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:42 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Deleted volume successfully. Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a6985ee2-24df-4430-9a08-e0aad0094c74 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-0902871e-266c-4a40-8754-934b20bcd97d-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Flow 'volume_create_manager' (ec0c6c14-62be-4311-9071-cd7a607f986b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c08e3ba-bf99-4e04-8a6c-fe3bdf437e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c08e3ba-bf99-4e04-8a6c-fe3bdf437e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072723862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc24423-34c2-4cfe-bd63-26c6482e9e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d77a8365fcb479997dafc3741b2bb27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:43Z,use_quota=True,user_id='8fc3b7b14a9043da89ff535bdeeb1ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4873afb1-4789-4c4c-87a8-c49fe9db4cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4873afb1-4789-4c4c-87a8-c49fe9db4cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59e8261-d6a9-443b-9565-7deb2ae8a2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59e8261-d6a9-443b-9565-7deb2ae8a2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc24423-34c2-4cfe-bd63-26c6482e9e51', 'volume_name': 'volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2deebf-2e2a-4152-a4b9-9e3dc7bbfa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2deebf-2e2a-4152-a4b9-9e3dc7bbfa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951cebf8-5296-48a6-a4ed-ffcb4fa7059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:43 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Volume fbc24423-34c2-4cfe-bd63-26c6482e9e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51', 'volume_size': 1} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072723862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc24423-34c2-4cfe-bd63-26c6482e9e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d77a8365fcb479997dafc3741b2bb27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:43Z,use_quota=True,user_id='8fc3b7b14a9043da89ff535bdeeb1ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Creating volume fbc24423-34c2-4cfe-bd63-26c6482e9e51 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:43 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:43 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51 1073741824 Jul 11 18:56:43 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:43 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" returned: 0 in 0.791s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:43 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea Jul 11 18:56:43 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:43 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" returned: 0 in 0.651s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "cinder-quobyte-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea" released by "delete_volume" :: held 1.504s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Created reservations ['5a0e7c3b-22d6-4e2a-ad36-e2ca4ddb6f83', '88b5c412-5f1d-4559-8b33-c83d303a1644', 'e3deb695-f489-47be-b3c0-fdcbb682d0a6', '1f869194-0805-46b1-ab64-a673db6d5f35'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:43 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51 1073741824" returned: 0 in 0.860s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:43 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51 Jul 11 18:56:43 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:44 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:44 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:44 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51" returned: 0 in 0.645s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951cebf8-5296-48a6-a4ed-ffcb4fa7059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000fe66e-9f21-4834-830d-c4b304d6b107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:44 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Volume volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51 (fbc24423-34c2-4cfe-bd63-26c6482e9e51): created successfully Jul 11 18:56:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000fe66e-9f21-4834-830d-c4b304d6b107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Flow 'volume_create_manager' (ec0c6c14-62be-4311-9071-cd7a607f986b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:44 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.682s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:44 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1e7d0fa9-afa1-4329-be36-f4e0a611e809 tempest-ProjectReaderTests-1435520402 None] Created volume successfully. Jul 11 18:56:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Deleted volume successfully. Jul 11 18:56:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1363b9f9-1c89-4d21-89bd-6bfc06828063 tempest-SnapshotMetadataTestJSON-1671777231 None] Lock "cinder-2a056ac3-121b-41fe-93ed-0c7fd49ad0ea-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "cinder-fbc24423-34c2-4cfe-bd63-26c6482e9e51-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-fbc24423-34c2-4cfe-bd63-26c6482e9e51-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "cinder-quobyte-fbc24423-34c2-4cfe-bd63-26c6482e9e51" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:45 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-quobyte-fbc24423-34c2-4cfe-bd63-26c6482e9e51" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:45 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0d98e2-1d79-46f6-88b2-921a22a71d83]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:45 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51 Jul 11 18:56:45 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:46 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51" returned: 0 in 0.871s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:46 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51 Jul 11 18:56:46 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:46 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fbc24423-34c2-4cfe-bd63-26c6482e9e51" returned: 0 in 0.644s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-quobyte-fbc24423-34c2-4cfe-bd63-26c6482e9e51" released by "delete_volume" :: held 1.566s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Created reservations ['725fe486-9641-4f1e-9369-52d274cd7297', 'e666d5db-7bd8-42a1-a63d-78c40eed55cd', '5a4c8521-a565-4c6d-85f2-43c8f18ce68b', '1349858e-b7b9-4374-b7a2-7d0348306687'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:46 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:46 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:47 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.656s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Deleted volume successfully. Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1f844de3-f45d-4d79-ac8b-a9060b6c5f85 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-fbc24423-34c2-4cfe-bd63-26c6482e9e51-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Flow 'volume_create_manager' (b0039c0a-84ff-4c34-9d93-4310e65e97d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd90778-605b-4b1e-8910-be6f19e80979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd90778-605b-4b1e-8910-be6f19e80979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983413620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0f4086-3dde-4a34-8e01-c560735dccad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d77a8365fcb479997dafc3741b2bb27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:48Z,use_quota=True,user_id='8fc3b7b14a9043da89ff535bdeeb1ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aeb4341-52fb-44b2-98cd-602575e92325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aeb4341-52fb-44b2-98cd-602575e92325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a82dda-7409-4366-87eb-f23c04d2e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a82dda-7409-4366-87eb-f23c04d2e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0f4086-3dde-4a34-8e01-c560735dccad', 'volume_name': 'volume-9c0f4086-3dde-4a34-8e01-c560735dccad', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe31950-d9c6-4f02-91f8-1ec2aec7017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe31950-d9c6-4f02-91f8-1ec2aec7017f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5696ce08-ec23-4179-9b29-c3b08771cc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:47 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Volume 9c0f4086-3dde-4a34-8e01-c560735dccad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0f4086-3dde-4a34-8e01-c560735dccad', 'volume_size': 1} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983413620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0f4086-3dde-4a34-8e01-c560735dccad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d77a8365fcb479997dafc3741b2bb27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:48Z,use_quota=True,user_id='8fc3b7b14a9043da89ff535bdeeb1ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Creating volume 9c0f4086-3dde-4a34-8e01-c560735dccad {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:47 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:56:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:47 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad 1073741824 Jul 11 18:56:47 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:48 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad 1073741824" returned: 0 in 0.866s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:48 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad Jul 11 18:56:48 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:49 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad" returned: 0 in 0.663s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:49 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:49 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5696ce08-ec23-4179-9b29-c3b08771cc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0f4086-3dde-4a34-8e01-c560735dccad', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:49 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3d3228-528c-441d-a05b-e3a925c822b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:49 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Volume volume-9c0f4086-3dde-4a34-8e01-c560735dccad (9c0f4086-3dde-4a34-8e01-c560735dccad): created successfully Jul 11 18:56:49 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3d3228-528c-441d-a05b-e3a925c822b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:49 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Flow 'volume_create_manager' (b0039c0a-84ff-4c34-9d93-4310e65e97d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:49 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c10516cc-8b0a-4828-b8fb-556463a5ed53 tempest-ProjectReaderTests-1435520402 None] Created volume successfully. Jul 11 18:56:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Acquiring lock "cinder-9c0f4086-3dde-4a34-8e01-c560735dccad-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Lock "cinder-9c0f4086-3dde-4a34-8e01-c560735dccad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Acquiring lock "cinder-quobyte-9c0f4086-3dde-4a34-8e01-c560735dccad" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Lock "cinder-quobyte-9c0f4086-3dde-4a34-8e01-c560735dccad" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:50 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1a4d6f-19f0-4c32-80a0-5c4a1277bd6e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:50 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad Jul 11 18:56:50 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:50 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad" returned: 0 in 0.784s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:50 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad Jul 11 18:56:50 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Flow 'volume_create_manager' (fa57904e-fcc8-47fe-b688-83393a66d5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40881029-01e7-4a30-baf6-f35312e40581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40881029-01e7-4a30-baf6-f35312e40581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-611836626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2456acb0-1de2-4483-83b4-56c799f40d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670b92ea76324ffeb1da3f9ebebce536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:51Z,use_quota=True,user_id='6112306553894d09816ff65fd2233667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd33ecea-ac21-42e4-b8cc-d6b587a16c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd33ecea-ac21-42e4-b8cc-d6b587a16c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94588a90-473d-4705-a3a8-99c7ac1a2986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94588a90-473d-4705-a3a8-99c7ac1a2986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2456acb0-1de2-4483-83b4-56c799f40d4d', 'volume_name': 'volume-2456acb0-1de2-4483-83b4-56c799f40d4d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1cc0d6-969d-4237-a97e-fde26af179d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1cc0d6-969d-4237-a97e-fde26af179d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6ab04a-2c55-4baa-aa73-92c287964e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:51 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Volume 2456acb0-1de2-4483-83b4-56c799f40d4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2456acb0-1de2-4483-83b4-56c799f40d4d', 'volume_size': 1} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-611836626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2456acb0-1de2-4483-83b4-56c799f40d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670b92ea76324ffeb1da3f9ebebce536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:51Z,use_quota=True,user_id='6112306553894d09816ff65fd2233667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Creating volume 2456acb0-1de2-4483-83b4-56c799f40d4d {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:51 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:51 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d 1073741824 Jul 11 18:56:51 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:51 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:51 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:51 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9c0f4086-3dde-4a34-8e01-c560735dccad" returned: 0 in 0.679s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Lock "cinder-quobyte-9c0f4086-3dde-4a34-8e01-c560735dccad" released by "delete_volume" :: held 1.506s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=109,cinder:SELECT=92,cinder:INSERT=36,cinder:DELETE=4 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Created reservations ['d3432e95-b962-432a-ae24-b377f7c80afb', 'e2b8214b-76fd-4ba2-a668-4e8d671cc652', 'd4cc0a64-b15c-4f34-aef1-dd9075559e4c', '6dc67376-d5e6-4587-afc2-9c3a63cf91b8'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:51 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:51 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:52 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d 1073741824" returned: 0 in 0.819s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:52 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.738s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:52 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d Jul 11 18:56:52 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:56:52 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.682s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:52 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Deleted volume successfully. Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dfd75c00-5e66-494a-aada-b5b7a513c5cc tempest-ProjectReaderTests-1435520402 None] Lock "cinder-9c0f4086-3dde-4a34-8e01-c560735dccad-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Flow 'volume_create_manager' (7c4f6ff8-da2d-4616-a46b-3e9f6fe04bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a852e68-27ba-42c2-affd-dd32b53e8aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a852e68-27ba-42c2-affd-dd32b53e8aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1578454809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d77a8365fcb479997dafc3741b2bb27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:53Z,use_quota=True,user_id='8fc3b7b14a9043da89ff535bdeeb1ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e822489-c2f8-4221-8cd4-6a000cc32712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e822489-c2f8-4221-8cd4-6a000cc32712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbeac0e-46b4-420a-a463-fdd553b30b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbeac0e-46b4-420a-a463-fdd553b30b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2', 'volume_name': 'volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d6e041-1494-4d72-9557-b10fc9c606d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d6e041-1494-4d72-9557-b10fc9c606d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc73d487-06bd-42c5-adf2-4bbebfa22b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:52 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Volume 05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2', 'volume_size': 1} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:52 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d" returned: 0 in 0.686s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.087s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1578454809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d77a8365fcb479997dafc3741b2bb27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:53Z,use_quota=True,user_id='8fc3b7b14a9043da89ff535bdeeb1ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Creating volume 05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:52 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:52 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 1073741824 Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6ab04a-2c55-4baa-aa73-92c287964e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2456acb0-1de2-4483-83b4-56c799f40d4d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:52 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6b744c-b703-4663-9f68-1ed4f10d065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:52 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Volume volume-2456acb0-1de2-4483-83b4-56c799f40d4d (2456acb0-1de2-4483-83b4-56c799f40d4d): created successfully Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6b744c-b703-4663-9f68-1ed4f10d065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Flow 'volume_create_manager' (fa57904e-fcc8-47fe-b688-83393a66d5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:52 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1ec0e520-31d1-431a-b0ab-83185b93dffd tempest-VolumesTransfersTest-587600169 None] Created volume successfully. Jul 11 18:56:53 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 1073741824" returned: 0 in 0.835s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:53 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 Jul 11 18:56:53 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:53 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f3d5eeb7-5153-4692-a293-4f18c4032505 tempest-VolumesTransfersTest-1426322586 None] Transfer volume completed successfully. Jul 11 18:56:54 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2" returned: 0 in 0.636s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc73d487-06bd-42c5-adf2-4bbebfa22b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682edcb6-48e3-41b6-bb80-e480683237d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:54 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Volume volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 (05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2): created successfully Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682edcb6-48e3-41b6-bb80-e480683237d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Flow 'volume_create_manager' (7c4f6ff8-da2d-4616-a46b-3e9f6fe04bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:54 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a0ca1f48-8407-42a6-9dd0-5df4f1550e83 tempest-ProjectReaderTests-1435520402 None] Created volume successfully. Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Acquiring lock "cinder-2456acb0-1de2-4483-83b4-56c799f40d4d-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Lock "cinder-2456acb0-1de2-4483-83b4-56c799f40d4d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "cinder-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Acquiring lock "cinder-quobyte-2456acb0-1de2-4483-83b4-56c799f40d4d" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Lock "cinder-quobyte-2456acb0-1de2-4483-83b4-56c799f40d4d" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[14172796-7698-4b0e-9196-b99a6bd359fa]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "cinder-quobyte-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-quobyte-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d59e36-4de3-42c5-91e0-03c352e04921]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:54 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d Jul 11 18:56:54 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:55 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 Jul 11 18:56:55 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:55 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d" returned: 0 in 0.771s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:55 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d Jul 11 18:56:55 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:55 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2" returned: 0 in 0.785s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:55 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2 Jul 11 18:56:55 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:56 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2456acb0-1de2-4483-83b4-56c799f40d4d" returned: 0 in 0.654s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Lock "cinder-quobyte-2456acb0-1de2-4483-83b4-56c799f40d4d" released by "delete_volume" :: held 1.468s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Created reservations ['77e9102f-bbb4-4928-99b1-0e53f8a450f8', '607e1877-082e-4842-ad2c-772cff6df77a', '22e76508-216d-48e0-b7cf-e77fbf567a1e', '2b9d4c39-ced0-4e35-a762-8a0d7718275f'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:56 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2" returned: 0 in 0.630s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-quobyte-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2" released by "delete_volume" :: held 1.460s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Created reservations ['9cef48d6-6f12-4954-aee4-990f8aba604f', 'ac84ab9d-4324-4bf8-8a28-febbba7fff48', 'eff4a478-0a45-4a44-98e3-0f812973d703', '85f59bce-e9bc-4876-8a19-69d0266dd2b9'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:56:56 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:56 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:56 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:56:56 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:57 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.691s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:57 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Deleted volume successfully. Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-80b376d4-5a74-4191-b9f5-236b64643452 tempest-VolumesTransfersTest-1795769658 None] Lock "cinder-2456acb0-1de2-4483-83b4-56c799f40d4d-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:57 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.767s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:56:57 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Deleted volume successfully. Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5a4122eb-7480-4c53-bc6a-fd6965da2e28 tempest-ProjectReaderTests-1435520402 None] Lock "cinder-05d0a0ad-acfa-4b01-91c5-72dbc7bb04b2-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Flow 'volume_create_manager' (3ef87102-d563-4eb1-8db2-5e10aa5f0c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5362a79b-a29f-4420-96d3-9e2dff28effe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5362a79b-a29f-4420-96d3-9e2dff28effe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-523654922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921614d5-5eaf-49d5-9041-628be23192d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670b92ea76324ffeb1da3f9ebebce536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:58Z,use_quota=True,user_id='6112306553894d09816ff65fd2233667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ca6c01-22fe-4da6-9513-5463bdf34efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ca6c01-22fe-4da6-9513-5463bdf34efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610e6678-aaf9-40a7-8d25-7f3a9a9b0de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (610e6678-aaf9-40a7-8d25-7f3a9a9b0de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921614d5-5eaf-49d5-9041-628be23192d0', 'volume_name': 'volume-921614d5-5eaf-49d5-9041-628be23192d0', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e3191-0364-43d3-b2fc-7a37ad997d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866e3191-0364-43d3-b2fc-7a37ad997d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5819b66-4396-4f72-b2c0-56d41b8428c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:57 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Volume 921614d5-5eaf-49d5-9041-628be23192d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921614d5-5eaf-49d5-9041-628be23192d0', 'volume_size': 1} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-523654922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921614d5-5eaf-49d5-9041-628be23192d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670b92ea76324ffeb1da3f9ebebce536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:56:58Z,use_quota=True,user_id='6112306553894d09816ff65fd2233667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Creating volume 921614d5-5eaf-49d5-9041-628be23192d0 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:56:57 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:56:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:57 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0 1073741824 Jul 11 18:56:57 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:58 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0 1073741824" returned: 0 in 0.837s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:56:58 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0 Jul 11 18:56:58 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:56:59 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0" returned: 0 in 0.649s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5819b66-4396-4f72-b2c0-56d41b8428c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921614d5-5eaf-49d5-9041-628be23192d0', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3ac578-0c5a-4b78-a71b-e8cc20206890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:56:59 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Volume volume-921614d5-5eaf-49d5-9041-628be23192d0 (921614d5-5eaf-49d5-9041-628be23192d0): created successfully Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3ac578-0c5a-4b78-a71b-e8cc20206890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Flow 'volume_create_manager' (3ef87102-d563-4eb1-8db2-5e10aa5f0c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:56:59 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-15505dfc-7e5f-4d2e-b297-71eef47a3fd5 tempest-VolumesTransfersTest-587600169 None] Created volume successfully. Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Acquiring lock "cinder-921614d5-5eaf-49d5-9041-628be23192d0-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Lock "cinder-921614d5-5eaf-49d5-9041-628be23192d0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Acquiring lock "cinder-quobyte-921614d5-5eaf-49d5-9041-628be23192d0" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Lock "cinder-quobyte-921614d5-5eaf-49d5-9041-628be23192d0" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c44907-8444-4212-96e9-eb764b4066df]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:56:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:00 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0 Jul 11 18:57:00 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:00 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0" returned: 0 in 0.746s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:00 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0 Jul 11 18:57:00 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:01 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-921614d5-5eaf-49d5-9041-628be23192d0" returned: 0 in 0.615s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Lock "cinder-quobyte-921614d5-5eaf-49d5-9041-628be23192d0" released by "delete_volume" :: held 1.403s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:57:01 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Created reservations ['2847e3e9-92b4-4995-9ae0-2ab01067a233', 'e52ea4a6-4d36-449d-91de-75049982f32e', '80825fab-053e-41ff-b47a-88fd5fecc244', 'b1c8bed1-7a67-4d6d-8835-fdd2251eb8c9'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:57:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:57:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:57:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:01 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:57:01 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:02 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.640s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:02 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:57:02 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Deleted volume successfully. Jul 11 18:57:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-46924378-7c16-4810-9431-6be616284263 tempest-VolumesTransfersTest-1795769658 None] Lock "cinder-921614d5-5eaf-49d5-9041-628be23192d0-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:57:11 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:INSERT=7,cinder:UPDATE=46,cinder:SELECT=22,cinder:DELETE=3 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:57:12 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:INSERT=29,cinder:UPDATE=121,cinder:SELECT=81,cinder:DELETE=15 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:57:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:57:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:57:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:57:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:57:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:57:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:57:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:57:51 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:57:51 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:57:52 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 11 18:57:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.637s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:57:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:57:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:57:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:57:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Flow 'volume_create_manager' (5c7387c8-5816-410e-af7f-ec61117e54d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287f4f01-edc4-4be2-b4d6-e1f8326f119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287f4f01-edc4-4be2-b4d6-e1f8326f119f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-180997309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1b05ed-6427-4903-b47c-1f77630c9339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b8ed240fed4396aff3468378af2d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:02Z,use_quota=True,user_id='b664e36d3cc7480cbf890476077f777f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c434480e-6cdb-4b61-a00d-b159fec5d311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c434480e-6cdb-4b61-a00d-b159fec5d311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fb8139-527e-4c06-9130-d03cb432dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fb8139-527e-4c06-9130-d03cb432dd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1b05ed-6427-4903-b47c-1f77630c9339', 'volume_name': 'volume-1d1b05ed-6427-4903-b47c-1f77630c9339', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecead4ca-fd96-44eb-956a-6805dbd5e2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecead4ca-fd96-44eb-956a-6805dbd5e2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf7f915-5689-4172-813f-ae8d87a7a3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:02 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Volume 1d1b05ed-6427-4903-b47c-1f77630c9339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1b05ed-6427-4903-b47c-1f77630c9339', 'volume_size': 1} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-180997309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1b05ed-6427-4903-b47c-1f77630c9339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b8ed240fed4396aff3468378af2d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:02Z,use_quota=True,user_id='b664e36d3cc7480cbf890476077f777f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Creating volume 1d1b05ed-6427-4903-b47c-1f77630c9339 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:02 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:58:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:02 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 1073741824 Jul 11 18:58:02 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:03 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 1073741824" returned: 0 in 0.836s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:03 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 Jul 11 18:58:03 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:03 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339" returned: 0 in 0.613s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf7f915-5689-4172-813f-ae8d87a7a3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1b05ed-6427-4903-b47c-1f77630c9339', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a4e2c1-1918-481c-9355-71e1807db104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:03 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Volume volume-1d1b05ed-6427-4903-b47c-1f77630c9339 (1d1b05ed-6427-4903-b47c-1f77630c9339): created successfully Jul 11 18:58:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a4e2c1-1918-481c-9355-71e1807db104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Flow 'volume_create_manager' (5c7387c8-5816-410e-af7f-ec61117e54d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:03 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-02eef2a0-27ea-4c9a-9931-205459accb0d tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Created volume successfully. Jul 11 18:58:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-0aab0d67-3335-42ee-bbeb-4fb2e51297c8 req-ffec06f2-9feb-4498-98a2-03ebf7020f16 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-0aab0d67-3335-42ee-bbeb-4fb2e51297c8 req-ffec06f2-9feb-4498-98a2-03ebf7020f16 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:07 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[443e6daa-f961-48cd-8cbe-17f13223a82e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-0aab0d67-3335-42ee-bbeb-4fb2e51297c8 req-ffec06f2-9feb-4498-98a2-03ebf7020f16 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:07 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 Jul 11 18:58:07 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:08 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [req-0aab0d67-3335-42ee-bbeb-4fb2e51297c8 req-ffec06f2-9feb-4498-98a2-03ebf7020f16 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339" returned: 0 in 0.765s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [req-0aab0d67-3335-42ee-bbeb-4fb2e51297c8 req-ffec06f2-9feb-4498-98a2-03ebf7020f16 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:08 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-0aab0d67-3335-42ee-bbeb-4fb2e51297c8 req-ffec06f2-9feb-4498-98a2-03ebf7020f16 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e', 'name': 'volume-1d1b05ed-6427-4903-b47c-1f77630c9339', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b02aa78-610d-40bd-a32e-b94dc4d9f0bc', 'enforce_multipath': True} {{(pid=87411) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 18:58:08 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-0aab0d67-3335-42ee-bbeb-4fb2e51297c8 req-ffec06f2-9feb-4498-98a2-03ebf7020f16 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] attachment_update completed successfully. Jul 11 18:58:14 devstack cinder-volume[87411]: INFO cinder.volume.manager [req-f4cdd8d0-29f5-4b2b-b7cb-690a84133624 req-9c4bfda7-fcb4-4ced-aee9-c4ad1dd15cac tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Terminate volume connection completed successfully. Jul 11 18:58:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [req-f4cdd8d0-29f5-4b2b-b7cb-690a84133624 req-9c4bfda7-fcb4-4ced-aee9-c4ad1dd15cac tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Deleting attachment 6b02aa78-610d-40bd-a32e-b94dc4d9f0bc. {{(pid=87411) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 18:58:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Acquiring lock "cinder-1d1b05ed-6427-4903-b47c-1f77630c9339-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "cinder-1d1b05ed-6427-4903-b47c-1f77630c9339-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Acquiring lock "cinder-quobyte-1d1b05ed-6427-4903-b47c-1f77630c9339" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "cinder-quobyte-1d1b05ed-6427-4903-b47c-1f77630c9339" acquired by "delete_volume" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:16 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ded2e53-b18c-4f85-9d63-90993cf77262]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:16 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 Jul 11 18:58:16 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:17 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339" returned: 0 in 0.734s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:17 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339 Jul 11 18:58:17 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:17 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-1d1b05ed-6427-4903-b47c-1f77630c9339" returned: 0 in 0.629s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "cinder-quobyte-1d1b05ed-6427-4903-b47c-1f77630c9339" released by "delete_volume" :: held 1.400s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:17 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Created reservations ['2a8fc306-dee2-4fe6-bd03-7673b0b1dd84', '8f3eab6f-d0d0-46ef-aaa9-c01652f9087c', '5c13b75c-982a-48f4-8087-0358eb9b0692', 'ab3f9a3d-01b7-4b72-bb7a-a16762855a07'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:18 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:58:18 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:18 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.631s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:18 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Deleted volume successfully. Jul 11 18:58:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-50ad0385-604f-49e2-8164-cce8d98a0605 tempest-TestServerVolumeAttachScenarioOldVersion-1866725942 None] Lock "cinder-1d1b05ed-6427-4903-b47c-1f77630c9339-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:28 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=13,cinder:SELECT=14,cinder:INSERT=2 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:58:28 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (ee3be46d-f761-4b57-a678-f24178c35b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06fecdd-4e54-4352-827f-39d80ba595ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06fecdd-4e54-4352-827f-39d80ba595ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039553919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb059616-b394-4d31-b2fe-6ae197868dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:36Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337866d3-b1a5-4cf8-a82e-b99c8910374c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337866d3-b1a5-4cf8-a82e-b99c8910374c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff512b65-3c0d-4bfd-bf6b-f8357a2c8a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff512b65-3c0d-4bfd-bf6b-f8357a2c8a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb059616-b394-4d31-b2fe-6ae197868dd6', 'volume_name': 'volume-bb059616-b394-4d31-b2fe-6ae197868dd6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda2d79e-f2d5-494d-a3f4-b6a054470f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda2d79e-f2d5-494d-a3f4-b6a054470f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a9e4ab-28fb-459f-9770-5523fe0a4e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:36 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume bb059616-b394-4d31-b2fe-6ae197868dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb059616-b394-4d31-b2fe-6ae197868dd6', 'volume_size': 1} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039553919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb059616-b394-4d31-b2fe-6ae197868dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:36Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Creating volume bb059616-b394-4d31-b2fe-6ae197868dd6 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:36 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:58:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:36 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 1073741824 Jul 11 18:58:36 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:37 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 1073741824" returned: 0 in 0.776s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:37 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 Jul 11 18:58:37 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:37 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6" returned: 0 in 0.679s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a9e4ab-28fb-459f-9770-5523fe0a4e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb059616-b394-4d31-b2fe-6ae197868dd6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da73968-07b3-4cd5-911a-653744852694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:37 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume volume-bb059616-b394-4d31-b2fe-6ae197868dd6 (bb059616-b394-4d31-b2fe-6ae197868dd6): created successfully Jul 11 18:58:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da73968-07b3-4cd5-911a-653744852694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (ee3be46d-f761-4b57-a678-f24178c35b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d0220b27-f196-499f-80c2-fd02607cc036 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created volume successfully. Jul 11 18:58:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Creating offline snapshot 249c9b7f-206c-4759-802a-6128a31984c5 of volume bb059616-b394-4d31-b2fe-6ae197868dd6 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:58:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b18b16-ad16-4efc-96ac-93f62faddadf]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:38 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 Jul 11 18:58:38 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:39 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6" returned: 0 in 0.741s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:39 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 1G Jul 11 18:58:39 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:40 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 1G" returned: 0 in 0.801s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb059616-b394-4d31-b2fe-6ae197868dd6 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:40 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb059616-b394-4d31-b2fe-6ae197868dd6 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 Jul 11 18:58:40 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:40 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb059616-b394-4d31-b2fe-6ae197868dd6 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5" returned: 0 in 0.672s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:40 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 is being set with open permissions: ugo+rw Jul 11 18:58:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:40 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 Jul 11 18:58:40 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:41 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5" returned: 0 in 0.615s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:41 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.info Jul 11 18:58:41 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:42 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.info" returned: 0 in 0.619s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:42 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.info is being set with open permissions: ugo+rw Jul 11 18:58:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:42 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.info Jul 11 18:58:42 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:42 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.info" returned: 0 in 0.624s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.150s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:42 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-49675908-1ecf-4828-b199-091b0c5272cb tempest-CreateVolumesFromSnapshotTest-1549956070 None] Create snapshot completed successfully Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (86edb480-5aab-48bd-bef0-8e807889f8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de0b903-1cea-464d-9088-39547d393305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de0b903-1cea-464d-9088-39547d393305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1570265799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f8da84-3976-4d2b-abab-659a4c60820d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:44Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8545738d-39f5-472a-ac45-5da9dcf312fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8545738d-39f5-472a-ac45-5da9dcf312fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7efa7383-238f-4695-baa8-06f31070d26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7efa7383-238f-4695-baa8-06f31070d26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f8da84-3976-4d2b-abab-659a4c60820d', 'volume_name': 'volume-c6f8da84-3976-4d2b-abab-659a4c60820d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3ce38e-45e4-4267-a635-ec39d314cc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3ce38e-45e4-4267-a635-ec39d314cc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5100a2eb-6686-46f2-9307-8a025d2b2390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume c6f8da84-3976-4d2b-abab-659a4c60820d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f8da84-3976-4d2b-abab-659a4c60820d', 'volume_size': 1} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1570265799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f8da84-3976-4d2b-abab-659a4c60820d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:44Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Creating volume c6f8da84-3976-4d2b-abab-659a4c60820d {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:44 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:44 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d 1073741824 Jul 11 18:58:44 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (63ae0a62-00e2-449e-9432-83eea09f91c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6f72ad-1c05-4183-9458-b6ff93f90fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6f72ad-1c05-4183-9458-b6ff93f90fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1993173932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568513a5-5d13-4381-b997-8cb92efdbb6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:45Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c891c41e-ba25-428c-9905-8c269710a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c891c41e-ba25-428c-9905-8c269710a909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98041f23-8ace-4f3c-8475-adc769c23688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98041f23-8ace-4f3c-8475-adc769c23688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568513a5-5d13-4381-b997-8cb92efdbb6d', 'volume_name': 'volume-568513a5-5d13-4381-b997-8cb92efdbb6d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211116e9-c450-46ab-9401-32fdda069178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211116e9-c450-46ab-9401-32fdda069178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d48a40-9666-4015-b30f-ce3912921aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume 568513a5-5d13-4381-b997-8cb92efdbb6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568513a5-5d13-4381-b997-8cb92efdbb6d', 'volume_size': 1} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (458af8bd-99ba-4df3-9a6c-840286b192e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dab8b78-acb2-4236-8ee6-33ca4b127d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dab8b78-acb2-4236-8ee6-33ca4b127d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188102281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28da7aae-fd32-47a0-9e4c-bd182eab5ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:45Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35551757-5a5e-40d7-b787-f43c4bc5c45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35551757-5a5e-40d7-b787-f43c4bc5c45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e301d37-c429-49a3-ba8e-6a8c6ea0b790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e301d37-c429-49a3-ba8e-6a8c6ea0b790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28da7aae-fd32-47a0-9e4c-bd182eab5ef3', 'volume_name': 'volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac017252-5af5-4a04-a2e5-6e92af6d58eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac017252-5af5-4a04-a2e5-6e92af6d58eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fa8c0d-0d6a-43e4-9b8c-8d83556db07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume 28da7aae-fd32-47a0-9e4c-bd182eab5ef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3', 'volume_size': 1} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:45 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d 1073741824" returned: 0 in 0.887s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:45 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d Jul 11 18:58:45 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (877aad4e-2637-40ba-9ada-0bdb965127cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91788d0d-c5b2-42e2-9e1f-2ed7174a56dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91788d0d-c5b2-42e2-9e1f-2ed7174a56dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1752431398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a472af65-10b7-46f4-8020-8667c515f4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:45Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899d12e1-cd10-4223-ad13-b918ba006772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899d12e1-cd10-4223-ad13-b918ba006772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e20c63-969e-461f-bd93-bf4a9e916f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e20c63-969e-461f-bd93-bf4a9e916f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a472af65-10b7-46f4-8020-8667c515f4ee', 'volume_name': 'volume-a472af65-10b7-46f4-8020-8667c515f4ee', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4b36fc-45aa-46fb-b2a3-1fabccfb98fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4b36fc-45aa-46fb-b2a3-1fabccfb98fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51673b94-5985-4385-a80f-ec6cfe442334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume a472af65-10b7-46f4-8020-8667c515f4ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a472af65-10b7-46f4-8020-8667c515f4ee', 'volume_size': 1} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (c5422c91-394d-493f-92ba-c0ab1228925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c41cc36-ee81-4ed3-be50-12165332a840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c41cc36-ee81-4ed3-be50-12165332a840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861032429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebff08c-d8da-4e8d-87f2-ab05c7588f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:46Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a2c63e-b185-4688-a16e-ddabbd749975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a2c63e-b185-4688-a16e-ddabbd749975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0c9346-a5ff-4a94-b826-37e428221b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0c9346-a5ff-4a94-b826-37e428221b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebff08c-d8da-4e8d-87f2-ab05c7588f3a', 'volume_name': 'volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403003b9-ae60-43fe-988d-ce32cc36968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403003b9-ae60-43fe-988d-ce32cc36968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8f64c8-c94e-49aa-9490-60e9d6e0877c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:45 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume 2ebff08c-d8da-4e8d-87f2-ab05c7588f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a', 'volume_size': 1} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:45 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d" returned: 0 in 0.707s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.292s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1993173932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568513a5-5d13-4381-b997-8cb92efdbb6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:45Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Creating volume 568513a5-5d13-4381-b997-8cb92efdbb6d {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:45 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:45 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d 1073741824 Jul 11 18:58:45 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5100a2eb-6686-46f2-9307-8a025d2b2390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f8da84-3976-4d2b-abab-659a4c60820d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:45 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea65ac2-1305-4ef7-8475-6cb582027615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:46 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume volume-c6f8da84-3976-4d2b-abab-659a4c60820d (c6f8da84-3976-4d2b-abab-659a4c60820d): created successfully Jul 11 18:58:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea65ac2-1305-4ef7-8475-6cb582027615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (86edb480-5aab-48bd-bef0-8e807889f8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:46 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-05eec075-6671-4e2b-9bd1-b57112ebca75 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created volume successfully. Jul 11 18:58:46 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d 1073741824" returned: 0 in 0.803s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:46 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d Jul 11 18:58:46 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:47 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d" returned: 0 in 0.617s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.380s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1188102281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28da7aae-fd32-47a0-9e4c-bd182eab5ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:45Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Creating volume 28da7aae-fd32-47a0-9e4c-bd182eab5ef3 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:47 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d48a40-9666-4015-b30f-ce3912921aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568513a5-5d13-4381-b997-8cb92efdbb6d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:47 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3 1073741824 Jul 11 18:58:47 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9430d03-765e-45da-8e7c-219602bcc8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:47 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume volume-568513a5-5d13-4381-b997-8cb92efdbb6d (568513a5-5d13-4381-b997-8cb92efdbb6d): created successfully Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9430d03-765e-45da-8e7c-219602bcc8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (63ae0a62-00e2-449e-9432-83eea09f91c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5e714083-bbfd-493a-841b-0a8cf0062767 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created volume successfully. Jul 11 18:58:48 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3 1073741824" returned: 0 in 0.819s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:48 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3 Jul 11 18:58:48 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:48 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3" returned: 0 in 0.631s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.501s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1752431398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a472af65-10b7-46f4-8020-8667c515f4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:45Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Creating volume a472af65-10b7-46f4-8020-8667c515f4ee {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:48 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7fa8c0d-0d6a-43e4-9b8c-8d83556db07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:48 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee 1073741824 Jul 11 18:58:48 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ed5878-b363-41f2-b0b9-dfba49c5b817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:48 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3 (28da7aae-fd32-47a0-9e4c-bd182eab5ef3): created successfully Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ed5878-b363-41f2-b0b9-dfba49c5b817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (458af8bd-99ba-4df3-9a6c-840286b192e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:48 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-18a1da5a-29a5-42b0-a5c1-5978217850b8 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created volume successfully. Jul 11 18:58:49 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee 1073741824" returned: 0 in 0.781s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:49 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee Jul 11 18:58:49 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:50 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee" returned: 0 in 0.619s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.616s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861032429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebff08c-d8da-4e8d-87f2-ab05c7588f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682959baff6e4357a94b00c6a98ddf58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:58:46Z,use_quota=True,user_id='93c0871e3e584e1c9fe461936186fa27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Creating volume 2ebff08c-d8da-4e8d-87f2-ab05c7588f3a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:58:50 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51673b94-5985-4385-a80f-ec6cfe442334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a472af65-10b7-46f4-8020-8667c515f4ee', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:50 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a 1073741824 Jul 11 18:58:50 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8c4a97-1bd5-4f14-905a-bd7fd779c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume volume-a472af65-10b7-46f4-8020-8667c515f4ee (a472af65-10b7-46f4-8020-8667c515f4ee): created successfully Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8c4a97-1bd5-4f14-905a-bd7fd779c186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (877aad4e-2637-40ba-9ada-0bdb965127cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:50 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7fab3d6b-3414-4edf-8299-c68c5f165063 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created volume successfully. Jul 11 18:58:51 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a 1073741824" returned: 0 in 0.802s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:51 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a Jul 11 18:58:51 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:51 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:58:51 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:51 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a" returned: 0 in 0.633s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8f64c8-c94e-49aa-9490-60e9d6e0877c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf548b4-b82d-4345-9266-257991522f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:58:51 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Volume volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a (2ebff08c-d8da-4e8d-87f2-ab05c7588f3a): created successfully Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf548b4-b82d-4345-9266-257991522f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:58:51 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Flow 'volume_create_manager' (c5422c91-394d-493f-92ba-c0ab1228925d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:58:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-74f65ae5-bfc8-44a3-a37d-9f2f0d36ed6d tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created volume successfully. Jul 11 18:58:52 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.646s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-quobyte-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d79cf0-803f-48e1-a8e3-a45d6a5af891]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:52 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a Jul 11 18:58:52 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:53 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a" returned: 0 in 0.735s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:53 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a Jul 11 18:58:53 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:53 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a" returned: 0 in 0.617s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a" released by "delete_volume" :: held 1.387s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created reservations ['e81b566e-0956-46dd-84bb-65b9a2f7e02e', 'a3f6c27f-92df-42ad-9d9c-cf788c9fb8d1', '11a68b6e-6fd0-4e3d-9714-7591dbd009fb', '5d710370-9285-473d-a6ee-d0e7d8afdde7'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:53 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:58:53 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:54 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.631s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:54 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:54 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Deleted volume successfully. Jul 11 18:58:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-a472af65-10b7-46f4-8020-8667c515f4ee-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96e7b267-5058-490f-ab28-f259facdea33 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-2ebff08c-d8da-4e8d-87f2-ab05c7588f3a-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-a472af65-10b7-46f4-8020-8667c515f4ee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-quobyte-a472af65-10b7-46f4-8020-8667c515f4ee" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-a472af65-10b7-46f4-8020-8667c515f4ee" acquired by "delete_volume" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:54 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8196fd87-1100-40e8-9462-29a2972548fb]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:54 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee Jul 11 18:58:54 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:55 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee" returned: 0 in 0.734s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:55 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee Jul 11 18:58:55 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:55 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a472af65-10b7-46f4-8020-8667c515f4ee" returned: 0 in 0.617s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-a472af65-10b7-46f4-8020-8667c515f4ee" released by "delete_volume" :: held 1.389s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created reservations ['6bb3ef7a-67a2-4faf-acc7-3f7b06773011', '786dfacf-95b9-4709-bf72-b77bf7c0cae6', 'b85be200-6dea-41b6-bf8b-97cc0464a590', '433aed6c-3173-4f70-8ab2-290ba79a064f'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:56 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:58:56 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:56 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.654s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:56 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:56 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Deleted volume successfully. Jul 11 18:58:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cbef79a-7b4b-4273-972b-a271acf8249c tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-a472af65-10b7-46f4-8020-8667c515f4ee-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-28da7aae-fd32-47a0-9e4c-bd182eab5ef3-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-28da7aae-fd32-47a0-9e4c-bd182eab5ef3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-quobyte-28da7aae-fd32-47a0-9e4c-bd182eab5ef3" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:56 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-28da7aae-fd32-47a0-9e4c-bd182eab5ef3" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:56 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ecc520-e153-41e7-bddd-068b5b38da38]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:56 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3 Jul 11 18:58:56 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:57 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3" returned: 0 in 0.729s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:57 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3 Jul 11 18:58:57 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:58 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-28da7aae-fd32-47a0-9e4c-bd182eab5ef3" returned: 0 in 0.626s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-28da7aae-fd32-47a0-9e4c-bd182eab5ef3" released by "delete_volume" :: held 1.390s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created reservations ['f4bbbb57-ad09-4997-8c1e-8f964fad52e5', 'ee322d53-7802-401f-b868-4824958f6b25', 'd27268dd-1ddd-45ec-9e76-7c067340170e', '72fec2b9-5c71-4f11-8102-a942585b46ce'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:58 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:58:58 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:58 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.623s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:58:58 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Deleted volume successfully. Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d44bb570-8121-4f48-b53a-e86d4e9446c0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-28da7aae-fd32-47a0-9e4c-bd182eab5ef3-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-568513a5-5d13-4381-b997-8cb92efdbb6d-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-568513a5-5d13-4381-b997-8cb92efdbb6d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-quobyte-568513a5-5d13-4381-b997-8cb92efdbb6d" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-568513a5-5d13-4381-b997-8cb92efdbb6d" acquired by "delete_volume" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce46416-7061-449e-8a05-f673afd5e478]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:58:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:59 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d Jul 11 18:58:59 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:58:59 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 11 18:58:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d" returned: 0 in 0.726s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:58:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:58:59 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d Jul 11 18:58:59 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:00 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-568513a5-5d13-4381-b997-8cb92efdbb6d" returned: 0 in 0.660s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:00 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-568513a5-5d13-4381-b997-8cb92efdbb6d" released by "delete_volume" :: held 1.423s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:00 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created reservations ['c752575e-f6af-4d53-ac0a-01f4edd01af4', '6e3d47ed-2221-4a10-894a-6dad7e539648', '9d8087a4-bb79-4543-8319-da6d31532de7', '7299d819-7851-4246-920c-4ac05f664800'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:00 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:00 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:00 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:00 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-c6f8da84-3976-4d2b-abab-659a4c60820d-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:01 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.632s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-c6f8da84-3976-4d2b-abab-659a4c60820d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:01 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Deleted volume successfully. Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f63bdaf3-e1c0-420d-8f35-2a22ad1df996 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-568513a5-5d13-4381-b997-8cb92efdbb6d-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-quobyte-c6f8da84-3976-4d2b-abab-659a4c60820d" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-c6f8da84-3976-4d2b-abab-659a4c60820d" acquired by "delete_volume" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4dab7d-a147-4e45-b1c2-bbc8bd972f3a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:01 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d Jul 11 18:59:01 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:01 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d" returned: 0 in 0.742s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:01 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d Jul 11 18:59:01 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:02 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6f8da84-3976-4d2b-abab-659a4c60820d" returned: 0 in 0.645s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-c6f8da84-3976-4d2b-abab-659a4c60820d" released by "delete_volume" :: held 1.424s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:02 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created reservations ['622bcee4-2c70-4eb7-a5ab-41e12cf121ef', '83974898-13fa-42ad-9cdd-04e4b5019adf', 'ab806e7b-367c-4569-ae06-0c6e9aff43e7', '06d78f28-2065-44c9-b516-7071dcc1b338'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:02 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:02 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-249c9b7f-206c-4759-802a-6128a31984c5-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-249c9b7f-206c-4759-802a-6128a31984c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-quobyte-bb059616-b394-4d31-b2fe-6ae197868dd6" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-bb059616-b394-4d31-b2fe-6ae197868dd6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-quobyte-249c9b7f-206c-4759-802a-6128a31984c5" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-249c9b7f-206c-4759-802a-6128a31984c5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Deleting offline snapshot 249c9b7f-206c-4759-802a-6128a31984c5 of volume bb059616-b394-4d31-b2fe-6ae197868dd6 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:59:03 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] snapshot_file for this snap is: volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.711s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:03 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Deleted volume successfully. Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7cf5c9-40a0-4ca5-a975-12530db51a0c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-761d4bb5-f9d6-4b1c-8c51-b137830dc8a0 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-c6f8da84-3976-4d2b-abab-659a4c60820d-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:03 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 Jul 11 18:59:03 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:04 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5" returned: 0 in 0.771s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb059616-b394-4d31-b2fe-6ae197868dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:59:04 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e02a3bc-5c3b-485b-a3ff-092f8bc509e6]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:04 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 Jul 11 18:59:04 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:04 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6" returned: 0 in 0.732s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:05 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 Jul 11 18:59:05 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:05 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5" returned: 0 in 0.703s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:05 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5 Jul 11 18:59:05 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:06 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6.249c9b7f-206c-4759-802a-6128a31984c5" returned: 0 in 0.622s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-249c9b7f-206c-4759-802a-6128a31984c5" released by "_delete_snapshot" :: held 2.951s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-bb059616-b394-4d31-b2fe-6ae197868dd6" released by "delete_snapshot" :: held 2.978s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created reservations ['904c05dd-3908-4e94-9c9f-6bf5b96596f3', '149473f3-a326-4b23-afec-77a8ffc9175d', '4328946b-ab20-4dbe-8243-11e34ee15bff', '99e297bf-7640-4738-9031-5c2fa5469ec9'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:06 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Delete snapshot completed successfully. Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5cf92035-0279-4566-93d2-86abc7896674 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-249c9b7f-206c-4759-802a-6128a31984c5-delete_snapshot" released by "delete_snapshot" :: held 3.119s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-bb059616-b394-4d31-b2fe-6ae197868dd6-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-bb059616-b394-4d31-b2fe-6ae197868dd6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "cinder-quobyte-bb059616-b394-4d31-b2fe-6ae197868dd6" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-bb059616-b394-4d31-b2fe-6ae197868dd6" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4040ef9-703f-4979-b1f6-c496f6a700e8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:06 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 Jul 11 18:59:06 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:07 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6" returned: 0 in 0.729s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:07 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6 Jul 11 18:59:07 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:08 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-bb059616-b394-4d31-b2fe-6ae197868dd6" returned: 0 in 0.629s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-quobyte-bb059616-b394-4d31-b2fe-6ae197868dd6" released by "delete_volume" :: held 1.414s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Created reservations ['dd5e5921-1024-4889-87f7-645cfe0d2a95', '9e556074-4774-4d33-a036-9e62296e28a3', '276e7bec-814e-4e1f-908a-56ad4009bc17', 'bfd1e0d2-a0e7-4b2a-9b75-104456a27858'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:08 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:08 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:08 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.657s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:08 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Deleted volume successfully. Jul 11 18:59:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1a299f37-21da-4996-ad26-3d8c80fba301 tempest-CreateVolumesFromSnapshotTest-1549956070 None] Lock "cinder-bb059616-b394-4d31-b2fe-6ae197868dd6-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (ba9f0fd6-8e18-452e-9ac8-0882bffd3a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c1da44-b5b4-4991-97d9-1345a49d31f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c1da44-b5b4-4991-97d9-1345a49d31f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1527314584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630353a5-06b4-46dc-9d77-7c762784bb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:11Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f444b8-3795-45c6-9752-9022c934db72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f444b8-3795-45c6-9752-9022c934db72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbb1575-6402-407a-98dd-c0fd8d3c5ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbb1575-6402-407a-98dd-c0fd8d3c5ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '630353a5-06b4-46dc-9d77-7c762784bb88', 'volume_name': 'volume-630353a5-06b4-46dc-9d77-7c762784bb88', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20dd09af-8663-4aaa-b8c8-02b313cbb1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20dd09af-8663-4aaa-b8c8-02b313cbb1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53426b80-d787-445d-929d-fb111b9498c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:11 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume 630353a5-06b4-46dc-9d77-7c762784bb88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-630353a5-06b4-46dc-9d77-7c762784bb88', 'volume_size': 1} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1527314584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630353a5-06b4-46dc-9d77-7c762784bb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:11Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Creating volume 630353a5-06b4-46dc-9d77-7c762784bb88 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:11 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:59:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:11 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88 1073741824 Jul 11 18:59:11 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:12 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88 1073741824" returned: 0 in 0.796s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:12 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88 Jul 11 18:59:12 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:12 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88" returned: 0 in 0.635s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53426b80-d787-445d-929d-fb111b9498c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630353a5-06b4-46dc-9d77-7c762784bb88', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d18fa2-cf7d-462a-93c6-536826b8b73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:12 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume volume-630353a5-06b4-46dc-9d77-7c762784bb88 (630353a5-06b4-46dc-9d77-7c762784bb88): created successfully Jul 11 18:59:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d18fa2-cf7d-462a-93c6-536826b8b73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (ba9f0fd6-8e18-452e-9ac8-0882bffd3a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:12 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-657a36f7-eaba-4f36-bbe9-5b7c8cf8fbf4 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created volume successfully. Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (1e071b57-5815-4637-820d-09a69003d19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2fb5fc-f500-4c87-9897-10fad3aa2605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2fb5fc-f500-4c87-9897-10fad3aa2605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694248384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60995f55-ccb4-45d3-acff-9d6c21798f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:14Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256be843-90a3-4953-9d19-1dddf7a5d783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256be843-90a3-4953-9d19-1dddf7a5d783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc3063a-96c7-40dd-916c-7b3692faf812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc3063a-96c7-40dd-916c-7b3692faf812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60995f55-ccb4-45d3-acff-9d6c21798f4c', 'volume_name': 'volume-60995f55-ccb4-45d3-acff-9d6c21798f4c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38af0d7f-2fea-4d6d-947e-b5e58eb1760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38af0d7f-2fea-4d6d-947e-b5e58eb1760c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16b2668-9539-4122-8171-4bddc89cb1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:13 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume 60995f55-ccb4-45d3-acff-9d6c21798f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60995f55-ccb4-45d3-acff-9d6c21798f4c', 'volume_size': 1} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694248384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60995f55-ccb4-45d3-acff-9d6c21798f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:14Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Creating volume 60995f55-ccb4-45d3-acff-9d6c21798f4c {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:13 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:59:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:13 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c 1073741824 Jul 11 18:59:13 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (15246407-4f26-4ed4-8965-5c8eefae57ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43192464-78a4-4d21-8836-86a3b98769a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43192464-78a4-4d21-8836-86a3b98769a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304493433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b99b9b-6408-4ca7-8931-64c25cfc0f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:14Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109ce794-7050-4c96-8dc4-190f72bc14b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109ce794-7050-4c96-8dc4-190f72bc14b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6d803a-9a04-4c6e-b6a1-25419e6e95f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6d803a-9a04-4c6e-b6a1-25419e6e95f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b99b9b-6408-4ca7-8931-64c25cfc0f1e', 'volume_name': 'volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92be50c6-7bfb-4725-8084-9dbe9d161bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92be50c6-7bfb-4725-8084-9dbe9d161bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d704334-4333-4bbb-a612-fff6227acbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume c6b99b9b-6408-4ca7-8931-64c25cfc0f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e', 'volume_size': 1} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (31303c3e-4a9c-43ba-99a4-9f63a553b971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5265fd1a-8ec7-4997-9732-9dfe8f791ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5265fd1a-8ec7-4997-9732-9dfe8f791ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296174333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:14Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbf6a50-6134-495a-bee2-3c0f4c4b1ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbf6a50-6134-495a-bee2-3c0f4c4b1ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ed1851-2488-44a7-971d-b81f72d369be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ed1851-2488-44a7-971d-b81f72d369be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a', 'volume_name': 'volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02db3e3f-85f2-4ea7-850d-9f72c798838e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02db3e3f-85f2-4ea7-850d-9f72c798838e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d39f5b-d6d7-43b7-94fc-ab12ae8cd082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a', 'volume_size': 1} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:14 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c 1073741824" returned: 0 in 0.949s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (f577befc-9d90-4275-a268-30f4461b9e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf69de9-a494-473c-b058-ea2fc5cbcaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf69de9-a494-473c-b058-ea2fc5cbcaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128006015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2401f1f9-0c3e-4ad4-b196-1f2325992565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:15Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23879eae-3b8e-41af-a5c7-35c37655ddfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23879eae-3b8e-41af-a5c7-35c37655ddfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b7a021-5005-458b-9bb8-119ce973c4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b7a021-5005-458b-9bb8-119ce973c4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2401f1f9-0c3e-4ad4-b196-1f2325992565', 'volume_name': 'volume-2401f1f9-0c3e-4ad4-b196-1f2325992565', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23eedad8-adf6-4573-9c74-d72909a35c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23eedad8-adf6-4573-9c74-d72909a35c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80c6a8d-123b-4211-bdb6-9a982e591d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume 2401f1f9-0c3e-4ad4-b196-1f2325992565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2401f1f9-0c3e-4ad4-b196-1f2325992565', 'volume_size': 1} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:15 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c Jul 11 18:59:15 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (a1b01ff7-1241-4ff9-aea9-4cfc83f849e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df245cc-d9a2-4a9e-8580-f01620b107fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df245cc-d9a2-4a9e-8580-f01620b107fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-257170382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f0af2a-cb5e-416b-893c-d3ce11764c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:15Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321d5f87-b566-4612-8075-1e8da11628cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321d5f87-b566-4612-8075-1e8da11628cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7918561-574f-49c4-8beb-fdda5024c7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7918561-574f-49c4-8beb-fdda5024c7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f0af2a-cb5e-416b-893c-d3ce11764c5f', 'volume_name': 'volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbaf068-960f-4668-9216-b573ee77d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cbaf068-960f-4668-9216-b573ee77d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b3c31c-4813-4eb6-813d-5eda10368361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume 05f0af2a-cb5e-416b-893c-d3ce11764c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f', 'volume_size': 1} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:15 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c" returned: 0 in 0.655s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304493433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b99b9b-6408-4ca7-8931-64c25cfc0f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:14Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Creating volume c6b99b9b-6408-4ca7-8931-64c25cfc0f1e {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:15 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16b2668-9539-4122-8171-4bddc89cb1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60995f55-ccb4-45d3-acff-9d6c21798f4c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:15 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e 1073741824 Jul 11 18:59:15 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4100e825-e62d-48be-a438-0895afa2a2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume volume-60995f55-ccb4-45d3-acff-9d6c21798f4c (60995f55-ccb4-45d3-acff-9d6c21798f4c): created successfully Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4100e825-e62d-48be-a438-0895afa2a2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (1e071b57-5815-4637-820d-09a69003d19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-78fa002f-cf5b-403a-9620-3d291045c698 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created volume successfully. Jul 11 18:59:16 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e 1073741824" returned: 0 in 0.812s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:16 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e Jul 11 18:59:16 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:17 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e" returned: 0 in 0.631s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.560s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296174333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:14Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Creating volume a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:17 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d704334-4333-4bbb-a612-fff6227acbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:17 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a 1073741824 Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f71736-e042-4e16-9444-722235508f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:17 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:17 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e (c6b99b9b-6408-4ca7-8931-64c25cfc0f1e): created successfully Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f71736-e042-4e16-9444-722235508f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (15246407-4f26-4ed4-8965-5c8eefae57ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c767f674-7335-4290-8974-217f36d3da71 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created volume successfully. Jul 11 18:59:17 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a 1073741824" returned: 0 in 0.788s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:18 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a Jul 11 18:59:18 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:18 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a" returned: 0 in 0.634s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.626s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128006015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2401f1f9-0c3e-4ad4-b196-1f2325992565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:15Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Creating volume 2401f1f9-0c3e-4ad4-b196-1f2325992565 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:18 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d39f5b-d6d7-43b7-94fc-ab12ae8cd082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:18 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565 1073741824 Jul 11 18:59:18 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879e0563-eeb6-4d5f-a6cf-584e76f49f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:18 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a (a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a): created successfully Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879e0563-eeb6-4d5f-a6cf-584e76f49f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (31303c3e-4a9c-43ba-99a4-9f63a553b971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fcb37af2-68b8-4b25-9fe9-e5841a4cc09e tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created volume successfully. Jul 11 18:59:19 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565 1073741824" returned: 0 in 0.788s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:19 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565 Jul 11 18:59:19 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:20 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565" returned: 0 in 0.635s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.761s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-257170382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f0af2a-cb5e-416b-893c-d3ce11764c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c28ffe7bf94a2087d8af2f0d59bc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:15Z,use_quota=True,user_id='f86b56ac5d18489f9abce52d25ad350c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Creating volume 05f0af2a-cb5e-416b-893c-d3ce11764c5f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:20 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80c6a8d-123b-4211-bdb6-9a982e591d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2401f1f9-0c3e-4ad4-b196-1f2325992565', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:20 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f 1073741824 Jul 11 18:59:20 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56f126f-0fb3-4088-86d8-3dd2e86fea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:20 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume volume-2401f1f9-0c3e-4ad4-b196-1f2325992565 (2401f1f9-0c3e-4ad4-b196-1f2325992565): created successfully Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56f126f-0fb3-4088-86d8-3dd2e86fea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (f577befc-9d90-4275-a268-30f4461b9e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-055a4ba6-4b60-4c74-9966-4b0922943c95 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created volume successfully. Jul 11 18:59:20 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f 1073741824" returned: 0 in 0.806s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:20 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f Jul 11 18:59:20 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:21 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f" returned: 0 in 0.619s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b3c31c-4813-4eb6-813d-5eda10368361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7ea196-5e69-47bb-b149-f61ee47c28f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:21 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Volume volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f (05f0af2a-cb5e-416b-893c-d3ce11764c5f): created successfully Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7ea196-5e69-47bb-b149-f61ee47c28f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Flow 'volume_create_manager' (a1b01ff7-1241-4ff9-aea9-4cfc83f849e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:21 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-34887542-0ebd-4b5f-a5d7-5696fdbe9a1a tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created volume successfully. Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-05f0af2a-cb5e-416b-893c-d3ce11764c5f-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-05f0af2a-cb5e-416b-893c-d3ce11764c5f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-quobyte-05f0af2a-cb5e-416b-893c-d3ce11764c5f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-05f0af2a-cb5e-416b-893c-d3ce11764c5f" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9da3bb4-a0e3-4f62-a049-aa7e00d6cca7]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:21 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f Jul 11 18:59:21 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:22 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f" returned: 0 in 0.751s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:22 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f Jul 11 18:59:22 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:23 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-05f0af2a-cb5e-416b-893c-d3ce11764c5f" returned: 0 in 0.631s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-05f0af2a-cb5e-416b-893c-d3ce11764c5f" released by "delete_volume" :: held 1.420s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:23 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created reservations ['952115e9-2bc0-4d29-b21c-184a19f01655', '09e2852b-d642-49cb-ac03-b0590d2af1be', '0ae14070-3cfb-45b2-b648-06fab2f90653', '80d7c209-1005-4537-af26-df07031b088d'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:23 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:23 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-2401f1f9-0c3e-4ad4-b196-1f2325992565-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:24 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.632s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:24 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-2401f1f9-0c3e-4ad4-b196-1f2325992565-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Deleted volume successfully. Jul 11 18:59:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-01ca26ab-3743-468c-931d-4ee24c2183b2 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-05f0af2a-cb5e-416b-893c-d3ce11764c5f-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-quobyte-2401f1f9-0c3e-4ad4-b196-1f2325992565" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-2401f1f9-0c3e-4ad4-b196-1f2325992565" acquired by "delete_volume" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:24 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9479cab-3b1a-4eaf-a32c-451a9dd21c80]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:24 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565 Jul 11 18:59:24 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:24 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565" returned: 0 in 0.736s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:24 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565 Jul 11 18:59:24 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:25 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2401f1f9-0c3e-4ad4-b196-1f2325992565" returned: 0 in 0.622s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-2401f1f9-0c3e-4ad4-b196-1f2325992565" released by "delete_volume" :: held 1.394s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:25 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created reservations ['628fe478-9f14-47d4-aad3-984a24833c90', 'f582a211-e72d-46d2-bdff-128566640304', '7861b1c2-99a1-4cc8-b125-f14ff3ee3375', 'f34141e9-6299-465e-a44d-6f755adbf2d6'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:25 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:25 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:26 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.636s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:26 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:26 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Deleted volume successfully. Jul 11 18:59:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-25133a81-ce5f-424a-88b4-ebe0dcd12a99 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-2401f1f9-0c3e-4ad4-b196-1f2325992565-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-quobyte-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a" acquired by "delete_volume" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:26 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[48183d40-0e2e-4734-82b3-6a83a54c79c4]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:26 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a Jul 11 18:59:26 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:27 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a" returned: 0 in 0.749s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:27 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a Jul 11 18:59:27 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:27 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a" returned: 0 in 0.630s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a" released by "delete_volume" :: held 1.417s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created reservations ['b98cab04-06c9-4da7-a99f-ac5f50f57303', '1c98cc81-d318-4a52-80c9-da44d6bbacb8', '7a55fe0e-a3af-455c-ac9a-2405d3e95fef', 'b9b74f0f-0103-447b-91cb-fa7f31f4527f'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:27 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:27 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:28 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.623s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:28 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:28 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Deleted volume successfully. Jul 11 18:59:28 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=78,cinder:UPDATE=117,cinder:INSERT=23,cinder:DELETE=9 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:59:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-quobyte-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0b6b1b81-25fe-413d-b12f-58f92f1aac38 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-a0989f02-53ef-4e22-9eee-c3ff5cd5aa1a-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e" acquired by "delete_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:28 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[54006256-31bf-4a86-ad8f-de7adc8de9c8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:28 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e Jul 11 18:59:28 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:29 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e" returned: 0 in 0.733s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:29 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e Jul 11 18:59:29 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:29 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e" returned: 0 in 0.634s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:29 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e" released by "delete_volume" :: held 1.404s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:29 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=114,cinder:SELECT=81,cinder:DELETE=13,cinder:INSERT=30 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 18:59:29 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created reservations ['82be3143-6a63-414d-a0f1-f3eaffa0c8d4', 'c66e8563-62ff-4d18-82d0-29f61cf7d952', '64c155fb-3179-46c0-ba02-3f44451e7c59', '75076409-3f25-4aed-8737-e0bf5035183c'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:30 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:30 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-60995f55-ccb4-45d3-acff-9d6c21798f4c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:30 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-60995f55-ccb4-45d3-acff-9d6c21798f4c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.646s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:30 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Deleted volume successfully. Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6089a640-51a6-4fe3-9ae5-6aac40bcd9a0 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-c6b99b9b-6408-4ca7-8931-64c25cfc0f1e-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-quobyte-60995f55-ccb4-45d3-acff-9d6c21798f4c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-60995f55-ccb4-45d3-acff-9d6c21798f4c" acquired by "delete_volume" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6709273-923f-4cba-aa68-ef60d8d41fb5]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:30 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c Jul 11 18:59:30 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:31 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c" returned: 0 in 0.724s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:31 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c Jul 11 18:59:31 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:32 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-60995f55-ccb4-45d3-acff-9d6c21798f4c" returned: 0 in 0.637s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-60995f55-ccb4-45d3-acff-9d6c21798f4c" released by "delete_volume" :: held 1.397s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created reservations ['da95b1f0-7e79-45a3-942c-7ce2c1a35d22', '7f419509-f81f-4019-9e38-f87ce3bb1bc0', '13edcd59-4aef-4022-bef3-d05043ea6ef5', '105ff6de-1fe9-4eee-9b47-7835dd48840a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:32 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:32 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-630353a5-06b4-46dc-9d77-7c762784bb88-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-630353a5-06b4-46dc-9d77-7c762784bb88-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:32 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.641s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:32 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Deleted volume successfully. Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "cinder-quobyte-630353a5-06b4-46dc-9d77-7c762784bb88" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-92a26481-827d-4701-b65e-8b6fbb54ec41 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-60995f55-ccb4-45d3-acff-9d6c21798f4c-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-630353a5-06b4-46dc-9d77-7c762784bb88" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d332b7a4-02a7-4c21-ae03-7d1498f7ee27]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:33 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88 Jul 11 18:59:33 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:33 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88" returned: 0 in 0.729s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:33 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88 Jul 11 18:59:33 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:34 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-630353a5-06b4-46dc-9d77-7c762784bb88" returned: 0 in 0.624s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-quobyte-630353a5-06b4-46dc-9d77-7c762784bb88" released by "delete_volume" :: held 1.389s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:34 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Created reservations ['c63a572a-dc27-41c8-ad15-6a4a1b131f0f', '4df1957d-b14d-490a-a6e1-924abd224ed3', '733de853-1ca8-4738-8b78-1171c7da2569', '1bb7eb83-4a9d-4538-9898-d4b21005955d'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:34 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:34 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:35 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.633s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:35 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Deleted volume successfully. Jul 11 18:59:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-24cd4766-61ee-40ac-ac3d-3cc5704ab375 tempest-CreateVolumesFromSourceVolumeTest-396994967 None] Lock "cinder-630353a5-06b4-46dc-9d77-7c762784bb88-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Flow 'volume_create_manager' (52274d89-d366-458b-92e2-1cad846764dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c876ee8b-7956-40ea-b33e-e030d6b21f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c876ee8b-7956-40ea-b33e-e030d6b21f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4839af8e-8b18-4e5c-a765-45cc2445652c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e160db1714f5eb76873ee1b59fbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:38Z,use_quota=True,user_id='a2084f8f1d4342e9a1dbb7f8d531e44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a26c19-34ee-4927-ba7d-4619d2da4c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a26c19-34ee-4927-ba7d-4619d2da4c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a922217c-5cc7-4e53-a4b2-b0c996c1dc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a922217c-5cc7-4e53-a4b2-b0c996c1dc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4839af8e-8b18-4e5c-a765-45cc2445652c', 'volume_name': 'volume-4839af8e-8b18-4e5c-a765-45cc2445652c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73691b4-5bb5-42e0-b6ed-bcae0e0a0336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73691b4-5bb5-42e0-b6ed-bcae0e0a0336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd76fc86-8251-4ffb-843e-fe08e77aeba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:37 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Volume 4839af8e-8b18-4e5c-a765-45cc2445652c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4839af8e-8b18-4e5c-a765-45cc2445652c', 'volume_size': 1} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4839af8e-8b18-4e5c-a765-45cc2445652c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e160db1714f5eb76873ee1b59fbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:38Z,use_quota=True,user_id='a2084f8f1d4342e9a1dbb7f8d531e44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Creating volume 4839af8e-8b18-4e5c-a765-45cc2445652c {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:37 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:59:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:37 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c 1073741824 Jul 11 18:59:37 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:38 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c 1073741824" returned: 0 in 0.769s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:38 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c Jul 11 18:59:38 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:39 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c" returned: 0 in 0.624s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd76fc86-8251-4ffb-843e-fe08e77aeba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4839af8e-8b18-4e5c-a765-45cc2445652c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13674b14-ed8a-4339-8914-f52001c2298a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:39 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Volume volume-4839af8e-8b18-4e5c-a765-45cc2445652c (4839af8e-8b18-4e5c-a765-45cc2445652c): created successfully Jul 11 18:59:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13674b14-ed8a-4339-8914-f52001c2298a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Flow 'volume_create_manager' (52274d89-d366-458b-92e2-1cad846764dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:39 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4317d1c9-8fb8-4be0-93aa-41b3d356494b tempest-CinderUnicodeTest-1069874017 None] Created volume successfully. Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Flow 'volume_create_manager' (dc2c39f8-b264-4c4a-8f90-3412dac58b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582c02de-6e92-45ed-9853-1bb722aec346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582c02de-6e92-45ed-9853-1bb722aec346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1177093728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bfb4fc-c9b7-482a-8d84-4d4b906872e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e160db1714f5eb76873ee1b59fbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:40Z,use_quota=True,user_id='a2084f8f1d4342e9a1dbb7f8d531e44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322ebaee-3aea-4844-be77-86a35c059925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322ebaee-3aea-4844-be77-86a35c059925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d884d2bb-a35c-4588-8872-4d6a01c83db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d884d2bb-a35c-4588-8872-4d6a01c83db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58bfb4fc-c9b7-482a-8d84-4d4b906872e6', 'volume_name': 'volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191345c1-049b-4417-a8aa-a3ae59941e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191345c1-049b-4417-a8aa-a3ae59941e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086232e0-3356-4419-98e2-35cf837012dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:40 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Volume 58bfb4fc-c9b7-482a-8d84-4d4b906872e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6', 'volume_size': 1} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T16:59:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1177093728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bfb4fc-c9b7-482a-8d84-4d4b906872e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8e160db1714f5eb76873ee1b59fbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T16:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T16:59:40Z,use_quota=True,user_id='a2084f8f1d4342e9a1dbb7f8d531e44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Creating volume 58bfb4fc-c9b7-482a-8d84-4d4b906872e6 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 18:59:40 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 18:59:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:40 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 1073741824 Jul 11 18:59:40 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:41 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 1073741824" returned: 0 in 0.788s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:41 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 Jul 11 18:59:41 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:41 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" returned: 0 in 0.633s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 18:59:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (086232e0-3356-4419-98e2-35cf837012dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5959e5a3-7aa6-462a-899e-8fc0b6b70a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 18:59:41 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Volume volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 (58bfb4fc-c9b7-482a-8d84-4d4b906872e6): created successfully Jul 11 18:59:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5959e5a3-7aa6-462a-899e-8fc0b6b70a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 18:59:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Flow 'volume_create_manager' (dc2c39f8-b264-4c4a-8f90-3412dac58b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 18:59:41 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5c184211-8f06-4add-a66e-12b0bb913ead tempest-CinderUnicodeTest-1069874017 None] Created volume successfully. Jul 11 18:59:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Creating offline snapshot 5442c56c-b5c5-41e1-a354-ddeb41cd1827 of volume 58bfb4fc-c9b7-482a-8d84-4d4b906872e6 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 18:59:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7de55a-cd96-4a8e-9023-b2cfb38ffc03]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:42 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 Jul 11 18:59:42 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:43 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" returned: 0 in 0.721s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:43 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 1G Jul 11 18:59:43 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:43 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 1G" returned: 0 in 0.752s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:43 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 Jul 11 18:59:43 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:44 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827" returned: 0 in 0.669s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:44 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 is being set with open permissions: ugo+rw Jul 11 18:59:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:44 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 Jul 11 18:59:44 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:45 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827" returned: 0 in 0.609s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:45 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.info Jul 11 18:59:45 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:45 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.info" returned: 0 in 0.611s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:45 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.info is being set with open permissions: ugo+rw Jul 11 18:59:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:45 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.info Jul 11 18:59:45 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:46 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.info" returned: 0 in 0.628s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.076s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:46 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f2a405f0-6bba-4162-893c-ceb243415695 tempest-CinderUnicodeTest-1069874017 None] Create snapshot completed successfully Jul 11 18:59:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "cinder-5442c56c-b5c5-41e1-a354-ddeb41cd1827-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-5442c56c-b5c5-41e1-a354-ddeb41cd1827-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "cinder-quobyte-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-quobyte-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "cinder-quobyte-5442c56c-b5c5-41e1-a354-ddeb41cd1827" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-quobyte-5442c56c-b5c5-41e1-a354-ddeb41cd1827" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Deleting offline snapshot 5442c56c-b5c5-41e1-a354-ddeb41cd1827 of volume 58bfb4fc-c9b7-482a-8d84-4d4b906872e6 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 18:59:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] snapshot_file for this snap is: volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 18:59:47 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca3e0b8-f772-4b94-9603-2705a49455b1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:47 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 Jul 11 18:59:47 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:48 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827" returned: 0 in 0.736s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 18:59:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cfc359-8a5d-42ba-a04e-5f698895d69c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:48 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 Jul 11 18:59:48 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:49 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" returned: 0 in 0.717s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:49 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 Jul 11 18:59:49 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:49 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827" returned: 0 in 0.692s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:49 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827 Jul 11 18:59:49 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:50 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6.5442c56c-b5c5-41e1-a354-ddeb41cd1827" returned: 0 in 0.608s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-quobyte-5442c56c-b5c5-41e1-a354-ddeb41cd1827" released by "_delete_snapshot" :: held 2.858s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-quobyte-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" released by "delete_snapshot" :: held 2.882s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Created reservations ['d79898c6-0d7e-456e-a5bf-cf2eb4a650ed', '515b9659-fd43-4bcd-a612-44473290828f', 'b65cc32c-e27e-4aa0-9f48-41ff5d424f15', 'c5aa1382-c392-47f2-9feb-28a343cfcc0e'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:50 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Delete snapshot completed successfully. Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f0ebec61-19e2-4f3e-9b1e-7c232fcd0fca tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-5442c56c-b5c5-41e1-a354-ddeb41cd1827-delete_snapshot" released by "delete_snapshot" :: held 3.005s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "cinder-58bfb4fc-c9b7-482a-8d84-4d4b906872e6-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-58bfb4fc-c9b7-482a-8d84-4d4b906872e6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "cinder-quobyte-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-quobyte-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[310929a0-5b4e-46ab-91f9-f801dfb24f53]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:51 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 Jul 11 18:59:51 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:59:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:51 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:51 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:51 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" returned: 0 in 0.741s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:51 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6 Jul 11 18:59:51 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:52 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.631s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 18:59:52 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" returned: 0 in 0.629s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-quobyte-58bfb4fc-c9b7-482a-8d84-4d4b906872e6" released by "delete_volume" :: held 1.424s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Created reservations ['88b142c1-ffd9-420b-a2e2-6934e98f6871', '3977b661-699c-49c6-93a7-b79a9866134b', '5fcaaa36-4833-4d18-a0bc-128b979bf41e', 'd864a2ee-daf2-42ae-bb26-6724836863db'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:52 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:52 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "cinder-4839af8e-8b18-4e5c-a765-45cc2445652c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-4839af8e-8b18-4e5c-a765-45cc2445652c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:53 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.669s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:53 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Deleted volume successfully. Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "cinder-quobyte-4839af8e-8b18-4e5c-a765-45cc2445652c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-quobyte-4839af8e-8b18-4e5c-a765-45cc2445652c" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fa8317a5-70c0-4e5a-bff8-0693c6b5e27d tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-58bfb4fc-c9b7-482a-8d84-4d4b906872e6-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[393774dc-2653-43c3-a0a8-f5b46cac4e2b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:53 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c Jul 11 18:59:53 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:53 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c" returned: 0 in 0.715s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:53 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c Jul 11 18:59:53 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:54 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4839af8e-8b18-4e5c-a765-45cc2445652c" returned: 0 in 0.614s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-quobyte-4839af8e-8b18-4e5c-a765-45cc2445652c" released by "delete_volume" :: held 1.367s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 18:59:54 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Created reservations ['1789f6e3-936e-4995-88a9-a0ef00162f22', 'e809ee81-5af5-476d-b611-0b6c7d25b1d3', 'f7c5f59d-60e8-4113-b88f-46dd8c947369', 'bdf49432-d188-496b-920f-5ddeb1963b80'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 18:59:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 18:59:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 18:59:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 18:59:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 18:59:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 18:59:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 18:59:54 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 18:59:54 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 18:59:55 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 11 18:59:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.622s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 18:59:55 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 18:59:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Deleted volume successfully. Jul 11 18:59:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e7fd2152-0b3d-47a8-bc73-92bc5b412dfb tempest-CinderUnicodeTest-1069874017 None] Lock "cinder-4839af8e-8b18-4e5c-a765-45cc2445652c-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:04 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=37,cinder:INSERT=19,cinder:UPDATE=51,cinder:DELETE=3 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:00:05 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=55,cinder:SELECT=37,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Flow 'volume_create_manager' (cb151b9b-1695-42e5-80e5-105c3927679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1b5a77-60d6-488d-99a1-0397c85b4874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1b5a77-60d6-488d-99a1-0397c85b4874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2046511769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94663d4-eabc-4ab8-b82d-59d3f35cb00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d994310f5049518b6bdb086992c081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:00:27Z,use_quota=True,user_id='b9e87a7082ef4098a56fb503f1a12686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff007b0c-4a2e-4064-959b-04f28649985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff007b0c-4a2e-4064-959b-04f28649985c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809c3ace-de9f-4a73-844e-1ebd6730b7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809c3ace-de9f-4a73-844e-1ebd6730b7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e94663d4-eabc-4ab8-b82d-59d3f35cb00b', 'volume_name': 'volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0b9758-7113-485a-840c-46b92541ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0b9758-7113-485a-840c-46b92541ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb73919-d85c-4075-9f45-71f4e2f6f22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:27 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Volume e94663d4-eabc-4ab8-b82d-59d3f35cb00b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b', 'volume_size': 1} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2046511769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94663d4-eabc-4ab8-b82d-59d3f35cb00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d994310f5049518b6bdb086992c081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:00:27Z,use_quota=True,user_id='b9e87a7082ef4098a56fb503f1a12686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Creating volume e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:00:27 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:27 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b 1073741824 Jul 11 19:00:27 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:27 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b 1073741824" returned: 0 in 0.782s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:27 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b Jul 11 19:00:27 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:28 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" returned: 0 in 0.613s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:00:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb73919-d85c-4075-9f45-71f4e2f6f22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74da4771-4828-4a6d-ad03-e962bbb1d2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:28 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Volume volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b (e94663d4-eabc-4ab8-b82d-59d3f35cb00b): created successfully Jul 11 19:00:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74da4771-4828-4a6d-ad03-e962bbb1d2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:28 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Flow 'volume_create_manager' (cb151b9b-1695-42e5-80e5-105c3927679d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:00:28 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9a760756-87d6-4c63-bd8c-901bb13cd873 tempest-SnapshotDependencyTests-2107132898 None] Created volume successfully. Jul 11 19:00:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Creating offline snapshot 10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc of volume e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:00:29 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[468ef0b6-81f1-4bac-85ad-580fd42fc903]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:29 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b Jul 11 19:00:29 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:30 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" returned: 0 in 0.749s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:30 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc 1G Jul 11 19:00:30 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:30 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc 1G" returned: 0 in 0.790s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:30 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc Jul 11 19:00:30 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:31 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc" returned: 0 in 0.734s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:31 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc is being set with open permissions: ugo+rw Jul 11 19:00:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:31 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc Jul 11 19:00:31 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:32 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc" returned: 0 in 0.616s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:32 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.info Jul 11 19:00:32 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:32 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.info" returned: 0 in 0.646s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:32 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.info is being set with open permissions: ugo+rw Jul 11 19:00:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:32 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.info Jul 11 19:00:32 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:33 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.info" returned: 0 in 0.624s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.242s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:33 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-38e06772-a27b-4bd6-b051-409052aa544d tempest-SnapshotDependencyTests-2107132898 None] Create snapshot completed successfully Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Flow 'volume_create_manager' (af8e0b96-a728-42fe-87b3-6cc5a0d727a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b017a18a-86a0-4e34-b119-f26c73b513ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b017a18a-86a0-4e34-b119-f26c73b513ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970d9b36-c051-48ad-8e4e-26d93fc44ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d994310f5049518b6bdb086992c081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:00:35Z,use_quota=True,user_id='b9e87a7082ef4098a56fb503f1a12686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a4917e-4462-45b2-8fdb-533feb647f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a4917e-4462-45b2-8fdb-533feb647f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43311e8-fa2d-487a-8c04-ff2d1b77f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43311e8-fa2d-487a-8c04-ff2d1b77f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '970d9b36-c051-48ad-8e4e-26d93fc44ce1', 'volume_name': 'volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1', 'volume_size': 1, 'snapshot_id': '10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d560240-9eee-49e8-8e56-465f12d8c7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d560240-9eee-49e8-8e56-465f12d8c7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55be0af0-2a00-4483-834f-be77c196997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:35 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Volume 970d9b36-c051-48ad-8e4e-26d93fc44ce1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1', 'volume_size': 1, 'snapshot_id': '10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc'} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "cinder-quobyte-10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc-970d9b36-c051-48ad-8e4e-26d93fc44ce1" by "_create_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc-970d9b36-c051-48ad-8e4e-26d93fc44ce1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Creating volume 970d9b36-c051-48ad-8e4e-26d93fc44ce1 from snapshot 10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc {{(pid=87411) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "cinder-quobyte-970d9b36-c051-48ad-8e4e-26d93fc44ce1" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-970d9b36-c051-48ad-8e4e-26d93fc44ce1" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] snapshot: 10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc, volume: 970d9b36-c051-48ad-8e4e-26d93fc44ce1, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bea3a0-01b2-42dc-a280-f2273678a937]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:35 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc Jul 11 19:00:35 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:35 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc" returned: 0 in 0.744s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 19:00:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 19:00:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad34bef4-b22f-4460-8aa1-5f566e8f95e2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:36 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b Jul 11 19:00:36 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:36 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" returned: 0 in 0.741s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:36 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 19:00:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:36 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 Jul 11 19:00:36 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:41 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1" returned: 0 in 4.401s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:41 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a49f1a4-df82-4fea-9257-9127fc9a6451]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:41 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b Jul 11 19:00:41 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:42 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" returned: 0 in 0.883s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:00:42 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Converted 1024.00 MB image at 232.64 MB/s Jul 11 19:00:42 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 is being set with open permissions: ugo+rw Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:42 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 Jul 11 19:00:42 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:42 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1" returned: 0 in 0.606s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-970d9b36-c051-48ad-8e4e-26d93fc44ce1" released by "_copy_volume_from_snapshot" :: held 7.456s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc-970d9b36-c051-48ad-8e4e-26d93fc44ce1" released by "_create_volume_from_snapshot" :: held 7.484s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.500s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55be0af0-2a00-4483-834f-be77c196997e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1', 'volume_size': 1, 'snapshot_id': '10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11878617-8271-49d7-b8ff-2627ff57c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:00:42 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Volume volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 (970d9b36-c051-48ad-8e4e-26d93fc44ce1): created successfully Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11878617-8271-49d7-b8ff-2627ff57c73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:00:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Flow 'volume_create_manager' (af8e0b96-a728-42fe-87b3-6cc5a0d727a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:00:42 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1cd2e4d7-4d2a-465c-ba8b-f7d8d5c1f87a tempest-SnapshotDependencyTests-2107132898 None] Created volume successfully. Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "cinder-10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "cinder-quobyte-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "cinder-quobyte-10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Deleting offline snapshot 10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc of volume e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] snapshot_file for this snap is: volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a18b6a-3471-4824-83dd-7ab904bb78b1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:44 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc Jul 11 19:00:44 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:44 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc" returned: 0 in 0.709s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e39e7-137e-4fa1-8e61-754b41d87941]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:44 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b Jul 11 19:00:44 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:45 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" returned: 0 in 0.735s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:45 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc Jul 11 19:00:45 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:46 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc" returned: 0 in 0.712s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:46 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc Jul 11 19:00:46 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:46 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b.10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc" returned: 0 in 0.612s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc" released by "_delete_snapshot" :: held 2.861s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" released by "delete_snapshot" :: held 2.883s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:47 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Created reservations ['9468b538-4369-460a-83b5-383a6d1a4d5c', 'ee7daf2d-f4c1-46c7-814e-29974f09a423', '270f6f06-4b4c-4aba-b470-69747ef442d5', 'bb00978c-2c13-4a99-8e3a-6e265eb29c90'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:00:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Delete snapshot completed successfully. Jul 11 19:00:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82d5f489-ab87-4238-a44c-a82770f5ea10 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-10bea31b-fc2a-4a7b-b0e8-b16d5fa51ecc-delete_snapshot" released by "delete_snapshot" :: held 3.002s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "cinder-e94663d4-eabc-4ab8-b82d-59d3f35cb00b-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-e94663d4-eabc-4ab8-b82d-59d3f35cb00b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "cinder-quobyte-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:47 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9f413c-53d8-4815-839e-167622165370]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:47 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b Jul 11 19:00:47 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:48 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" returned: 0 in 0.727s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:48 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b Jul 11 19:00:48 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:48 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" returned: 0 in 0.631s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-e94663d4-eabc-4ab8-b82d-59d3f35cb00b" released by "delete_volume" :: held 1.410s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Created reservations ['a347ba73-18b5-4b24-8996-f77650ed9fc6', 'c2131446-011c-4676-90e4-09de5013b036', '67852d36-3836-4e91-9c0a-8c73e9afb3fc', '6db48663-4356-4c84-a1db-21d6ef5ca6d3'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:48 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:00:48 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:49 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "cinder-970d9b36-c051-48ad-8e4e-26d93fc44ce1-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.633s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:49 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:00:49 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Deleted volume successfully. Jul 11 19:00:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-970d9b36-c051-48ad-8e4e-26d93fc44ce1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8117813a-41ce-437a-bb5e-8be4de5831a4 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-e94663d4-eabc-4ab8-b82d-59d3f35cb00b-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "cinder-quobyte-970d9b36-c051-48ad-8e4e-26d93fc44ce1" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:00:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-970d9b36-c051-48ad-8e4e-26d93fc44ce1" acquired by "delete_volume" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:00:49 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[944b3261-3c97-409c-9cfd-f328d737bc25]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:00:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:49 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 Jul 11 19:00:49 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:50 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1" returned: 0 in 0.734s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:50 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1 Jul 11 19:00:50 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:50 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-970d9b36-c051-48ad-8e4e-26d93fc44ce1" returned: 0 in 0.636s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-quobyte-970d9b36-c051-48ad-8e4e-26d93fc44ce1" released by "delete_volume" :: held 1.408s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Created reservations ['b022b395-f81e-479f-a457-9ebddf62b19f', '34c75cb8-e0c5-4965-afda-e3e891f7cc6c', 'decc4daf-3e0a-4478-a19f-f7dfae28bbf7', 'db1d7888-c83c-4f01-842e-43db14da44d1'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:51 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:00:51 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:00:51 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:00:51 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:00:51 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.644s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:00:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Deleted volume successfully. Jul 11 19:00:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7393a723-7b81-4748-adb4-fa56b6747360 tempest-SnapshotDependencyTests-2107132898 None] Lock "cinder-970d9b36-c051-48ad-8e4e-26d93fc44ce1-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:00:52 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 11 19:00:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.652s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:00:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:00:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:00:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:00:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:01:01 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:01:01 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (ffbce6a3-c348-4159-b677-dc5fda1e1b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07684a2e-aa6f-4247-90e8-5ace9fba338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07684a2e-aa6f-4247-90e8-5ace9fba338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-275464578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa397dcd-d130-423a-a20a-3696f3eb479a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:10Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544bbf3a-cb8e-43d2-b035-6c453691d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544bbf3a-cb8e-43d2-b035-6c453691d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1318c7e6-beef-45c2-ac9d-6f10b77592f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1318c7e6-beef-45c2-ac9d-6f10b77592f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa397dcd-d130-423a-a20a-3696f3eb479a', 'volume_name': 'volume-fa397dcd-d130-423a-a20a-3696f3eb479a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db99d83-560e-44da-89eb-2cf705d180b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db99d83-560e-44da-89eb-2cf705d180b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9a39d2-c176-4b37-96f0-e9b18eb49a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:10 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume fa397dcd-d130-423a-a20a-3696f3eb479a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa397dcd-d130-423a-a20a-3696f3eb479a', 'volume_size': 1} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-275464578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa397dcd-d130-423a-a20a-3696f3eb479a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:10Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Creating volume fa397dcd-d130-423a-a20a-3696f3eb479a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:10 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:10 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a 1073741824 Jul 11 19:01:10 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (c4f7bffb-4eba-429c-a521-8eccf2be0b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b5e79b-5473-4129-9abb-bcaa9f9d3a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b5e79b-5473-4129-9abb-bcaa9f9d3a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1735539661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37d1b20-0217-47d4-96cc-48f8864cc89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:10Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8d514e-eee6-4df6-a60d-beab66b5d91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8d514e-eee6-4df6-a60d-beab66b5d91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7220f9f4-8acc-42a5-b659-022c882f78aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7220f9f4-8acc-42a5-b659-022c882f78aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd37d1b20-0217-47d4-96cc-48f8864cc89b', 'volume_name': 'volume-d37d1b20-0217-47d4-96cc-48f8864cc89b', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9c0dff-9ad3-4cb0-90f2-a823980ce385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9c0dff-9ad3-4cb0-90f2-a823980ce385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc94808-08c7-4e0f-8133-823993891e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:10 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume d37d1b20-0217-47d4-96cc-48f8864cc89b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d37d1b20-0217-47d4-96cc-48f8864cc89b', 'volume_size': 1} Jul 11 19:01:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:11 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a 1073741824" returned: 0 in 0.918s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:11 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a Jul 11 19:01:11 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:11 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a" returned: 0 in 0.697s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.542s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1735539661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37d1b20-0217-47d4-96cc-48f8864cc89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:10Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Creating volume d37d1b20-0217-47d4-96cc-48f8864cc89b {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:11 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9a39d2-c176-4b37-96f0-e9b18eb49a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa397dcd-d130-423a-a20a-3696f3eb479a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f663068c-78b1-4a41-91c3-3975a4ea9f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:11 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b 1073741824 Jul 11 19:01:11 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:11 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume volume-fa397dcd-d130-423a-a20a-3696f3eb479a (fa397dcd-d130-423a-a20a-3696f3eb479a): created successfully Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f663068c-78b1-4a41-91c3-3975a4ea9f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:11 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (ffbce6a3-c348-4159-b677-dc5fda1e1b55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:11 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c764ceea-f873-4358-91b2-4356aae0a918 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created volume successfully. Jul 11 19:01:12 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b 1073741824" returned: 0 in 0.983s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:12 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b Jul 11 19:01:12 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:13 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b" returned: 0 in 0.719s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc94808-08c7-4e0f-8133-823993891e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d37d1b20-0217-47d4-96cc-48f8864cc89b', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b8d5e8-edec-494f-939a-05e6ba4f3756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:13 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume volume-d37d1b20-0217-47d4-96cc-48f8864cc89b (d37d1b20-0217-47d4-96cc-48f8864cc89b): created successfully Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b8d5e8-edec-494f-939a-05e6ba4f3756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (c4f7bffb-4eba-429c-a521-8eccf2be0b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:13 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c3b24e3c-b4c6-4dce-8d3c-a57996f26e9d tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created volume successfully. Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (49ca439b-658b-43c4-8d0b-5db176e56e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba9149d-7a0e-4b51-8afb-b39f276cbcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba9149d-7a0e-4b51-8afb-b39f276cbcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1715448294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8c572f-8441-4eb9-8b09-4cc726ab81d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:14Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9018dfd4-3b58-4493-8c59-b7fa76d8bd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9018dfd4-3b58-4493-8c59-b7fa76d8bd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c33b677-7581-42c7-b65c-852d065dd3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c33b677-7581-42c7-b65c-852d065dd3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e8c572f-8441-4eb9-8b09-4cc726ab81d3', 'volume_name': 'volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c04ccf-5115-4c3a-9365-46b4882c1d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c04ccf-5115-4c3a-9365-46b4882c1d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10823ca-9540-4741-8855-5ac7c0527f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:13 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume 5e8c572f-8441-4eb9-8b09-4cc726ab81d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3', 'volume_size': 1} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1715448294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e8c572f-8441-4eb9-8b09-4cc726ab81d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:14Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Creating volume 5e8c572f-8441-4eb9-8b09-4cc726ab81d3 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:13 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:13 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3 1073741824 Jul 11 19:01:13 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Flow 'volume_create_manager' (bf547491-2e2f-40d0-aacf-a88217f6a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b100581c-f47f-42d1-b7b3-63977c76428c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b100581c-f47f-42d1-b7b3-63977c76428c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf7e38b-c038-4b85-a0a1-9ec502618185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31197e546e1b42ea9a62e0c80691db88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:14Z,use_quota=True,user_id='289196509f5a4260853ae4260edfe448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba1c1e28-d146-4a33-a974-471a496c7fa8),volume_type_id=ba1c1e28-d146-4a33-a974-471a496c7fa8)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18a485c-b976-4aa3-9174-fa07e8a26906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18a485c-b976-4aa3-9174-fa07e8a26906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae106142-af4b-4f48-8fe8-d65b9e0bbf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.image.glance [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Creating Keystone auth plugin from conf {{(pid=87411) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (4a06ef9e-b8cb-4ed1-9c11-df4995c70aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf6df5c-6e88-4a71-b278-8529ee3fa61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf6df5c-6e88-4a71-b278-8529ee3fa61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1527885157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e01cc6-5d93-4fd5-9bdf-db233bbac41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:14Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ca55a3-08b0-44c9-aeeb-c32fd70dcd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ca55a3-08b0-44c9-aeeb-c32fd70dcd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298fd2ba-1722-402f-bbf2-4f860f3fc6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298fd2ba-1722-402f-bbf2-4f860f3fc6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e01cc6-5d93-4fd5-9bdf-db233bbac41f', 'volume_name': 'volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c4fef5-353f-4d2b-ba83-6165ff1f78c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c4fef5-353f-4d2b-ba83-6165ff1f78c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55b1ff5-2a9c-4f03-a8c1-4877f5e46e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume e0e01cc6-5d93-4fd5-9bdf-db233bbac41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f', 'volume_size': 1} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (eadcb95d-2687-4b5d-9a79-0c0054c7f6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a45bc6-bb71-4008-b2f4-5357f1e1a7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a45bc6-bb71-4008-b2f4-5357f1e1a7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-182289597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d044595-d62d-48e3-b53c-f1711b7a8f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:14Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98978e9d-e307-4131-85f2-2904cc3bda3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98978e9d-e307-4131-85f2-2904cc3bda3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3836ecc-4827-4602-b104-9e604030911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3836ecc-4827-4602-b104-9e604030911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d044595-d62d-48e3-b53c-f1711b7a8f79', 'volume_name': 'volume-3d044595-d62d-48e3-b53c-f1711b7a8f79', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7e03e1-254d-4fa6-b100-851e639b0d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7e03e1-254d-4fa6-b100-851e639b0d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48262a89-1b2a-48dd-acd7-32145ac61a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume 3d044595-d62d-48e3-b53c-f1711b7a8f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d044595-d62d-48e3-b53c-f1711b7a8f79', 'volume_size': 1} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae106142-af4b-4f48-8fe8-d65b9e0bbf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5bf7e38b-c038-4b85-a0a1-9ec502618185', 'volume_name': 'volume-5bf7e38b-c038-4b85-a0a1-9ec502618185', 'volume_size': 1, 'image_id': '695284a8-4785-4d4c-b5ee-864c442d4d35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/695284a8-4785-4d4c-b5ee-864c442d4d35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6dde2771b15cf06581b5f777eb312419', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31197e546e1b42ea9a62e0c80691db88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ef0e661a3ad301f4b55592d7a58d23dc0b736954ec14a2f1e0480a6972acd0ae2a6f07f44cb79f150c08cd35afdc5a9fa8b02d0a9bd9c95b54d05badeb2774f', 'id': '695284a8-4785-4d4c-b5ee-864c442d4d35', 'created_at': datetime.datetime(2026, 7, 11, 17, 1, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 1, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/695284a8-4785-4d4c-b5ee-864c442d4d35/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6444c7-b420-4708-8f8e-f0e670900425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6444c7-b420-4708-8f8e-f0e670900425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1afd66f-ca3b-43a0-87fa-1fb3119a00a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:14 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Volume 5bf7e38b-c038-4b85-a0a1-9ec502618185: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5bf7e38b-c038-4b85-a0a1-9ec502618185', 'volume_size': 1, 'image_id': '695284a8-4785-4d4c-b5ee-864c442d4d35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/695284a8-4785-4d4c-b5ee-864c442d4d35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6dde2771b15cf06581b5f777eb312419', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31197e546e1b42ea9a62e0c80691db88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ef0e661a3ad301f4b55592d7a58d23dc0b736954ec14a2f1e0480a6972acd0ae2a6f07f44cb79f150c08cd35afdc5a9fa8b02d0a9bd9c95b54d05badeb2774f', 'id': '695284a8-4785-4d4c-b5ee-864c442d4d35', 'created_at': datetime.datetime(2026, 7, 11, 17, 1, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 1, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/695284a8-4785-4d4c-b5ee-864c442d4d35/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Trying to clone 5bf7e38b-c038-4b85-a0a1-9ec502618185 from image 695284a8-4785-4d4c-b5ee-864c442d4d35 at location (None, [{'url': 'file:///opt/stack/data/glance/images/695284a8-4785-4d4c-b5ee-864c442d4d35', 'metadata': {}}]). {{(pid=87411) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 19:01:14 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Image download 0.00 MB at 0.00 MB/s Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b0ce16-989f-4dcb-8eb4-e0875eb0b717]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:14 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3 1073741824" returned: 0 in 1.172s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:15 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3 Jul 11 19:01:15 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:15 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD Jul 11 19:01:15 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (6842d423-6638-4846-848f-54bae8a74e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969f075f-7c31-49bc-b35d-5c11fcc70104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969f075f-7c31-49bc-b35d-5c11fcc70104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-653702195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0380d9c8-895c-478c-a7df-06fdb627dc39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:15Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd924fc-c031-476f-be64-dc032d111133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd924fc-c031-476f-be64-dc032d111133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456cde5b-5569-41df-8265-2e706d4a8803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456cde5b-5569-41df-8265-2e706d4a8803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0380d9c8-895c-478c-a7df-06fdb627dc39', 'volume_name': 'volume-0380d9c8-895c-478c-a7df-06fdb627dc39', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a58a9b0-57d7-413c-95e4-14a2cf4709a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a58a9b0-57d7-413c-95e4-14a2cf4709a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11c1cd3-36c8-43d5-b32e-fd5d6c271d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume 0380d9c8-895c-478c-a7df-06fdb627dc39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0380d9c8-895c-478c-a7df-06fdb627dc39', 'volume_size': 1} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:15 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3" returned: 0 in 0.696s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1527885157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e01cc6-5d93-4fd5-9bdf-db233bbac41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:14Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Creating volume e0e01cc6-5d93-4fd5-9bdf-db233bbac41f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:15 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:15 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:15 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f 1073741824 Jul 11 19:01:15 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (095b2909-9e22-4843-ba4e-f544547cf33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a53f39-a7bb-4a33-980e-87c171683139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD" returned: 0 in 0.858s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10823ca-9540-4741-8855-5ac7c0527f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11d3367-9a4a-4b86-b810-f18c7a054eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a53f39-a7bb-4a33-980e-87c171683139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693145973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a84ca38-00ac-4e89-aa37-5eeeacd683ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:16Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25906170-aa46-4937-be03-0eee8b7deea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25906170-aa46-4937-be03-0eee8b7deea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a18441-c2e5-4114-918e-845398c5a2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a18441-c2e5-4114-918e-845398c5a2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a84ca38-00ac-4e89-aa37-5eeeacd683ab', 'volume_name': 'volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421184d0-5e36-4710-b404-604235461212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421184d0-5e36-4710-b404-604235461212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6316b5b9-4d0a-4df4-a629-a4e2c7f9cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume 2a84ca38-00ac-4e89-aa37-5eeeacd683ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab', 'volume_size': 1} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3 (5e8c572f-8441-4eb9-8b09-4cc726ab81d3): created successfully Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11d3367-9a4a-4b86-b810-f18c7a054eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (49ca439b-658b-43c4-8d0b-5db176e56e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8fefd0f4-c8ec-46b5-a9ec-a7e3258d8997 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created volume successfully. Jul 11 19:01:15 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD Jul 11 19:01:15 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:16 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD" returned: 1 in 0.789s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:01:16 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Temporary image 695284a8-4785-4d4c-b5ee-864c442d4d35 is fetched for user 289196509f5a4260853ae4260edfe448. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 19:01:16 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f 1073741824" returned: 0 in 0.865s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:16 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b9f89b-9cc0-4c3d-b9ca-b52731c9d3df]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:16 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f Jul 11 19:01:16 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:16 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD Jul 11 19:01:16 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:17 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f" returned: 0 in 0.660s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.646s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-182289597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d044595-d62d-48e3-b53c-f1711b7a8f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:14Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Creating volume 3d044595-d62d-48e3-b53c-f1711b7a8f79 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:17 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55b1ff5-2a9c-4f03-a8c1-4877f5e46e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2049da9a-cad6-480e-97f5-872f35c10ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:17 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79 1073741824 Jul 11 19:01:17 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:17 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f (e0e01cc6-5d93-4fd5-9bdf-db233bbac41f): created successfully Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2049da9a-cad6-480e-97f5-872f35c10ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (4a06ef9e-b8cb-4ed1-9c11-df4995c70aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-047c2741-642c-4bfd-a757-6b04f699f026 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created volume successfully. Jul 11 19:01:17 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:17 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD Jul 11 19:01:17 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:18 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79 1073741824" returned: 0 in 0.969s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:18 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD" returned: 1 in 0.830s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:01:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:18 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79 Jul 11 19:01:18 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:19 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79" returned: 0 in 0.640s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.280s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Creating offline snapshot c802db57-b44f-4735-90e6-3e26b9724849 of volume d37d1b20-0217-47d4-96cc-48f8864cc89b {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48262a89-1b2a-48dd-acd7-32145ac61a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d044595-d62d-48e3-b53c-f1711b7a8f79', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ec948b-7480-4656-9dcd-e1586aad0b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62be898-3ec3-4506-879e-0569f3f2e08a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:19 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume volume-3d044595-d62d-48e3-b53c-f1711b7a8f79 (3d044595-d62d-48e3-b53c-f1711b7a8f79): created successfully Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ec948b-7480-4656-9dcd-e1586aad0b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (eadcb95d-2687-4b5d-9a79-0c0054c7f6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:19 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7dc63326-b838-4e5e-9bdc-e85c5bd0ef30 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created volume successfully. Jul 11 19:01:19 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b Jul 11 19:01:19 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:19 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b" returned: 0 in 0.773s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:19 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 1G Jul 11 19:01:19 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:20 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 1G" returned: 0 in 0.783s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d37d1b20-0217-47d4-96cc-48f8864cc89b -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:20 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d37d1b20-0217-47d4-96cc-48f8864cc89b -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 Jul 11 19:01:20 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:21 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d37d1b20-0217-47d4-96cc-48f8864cc89b -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849" returned: 0 in 0.719s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:21 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 is being set with open permissions: ugo+rw Jul 11 19:01:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:21 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 Jul 11 19:01:21 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:22 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849" returned: 0 in 0.697s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:22 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.info Jul 11 19:01:22 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:22 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.info" returned: 0 in 0.650s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:22 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.info is being set with open permissions: ugo+rw Jul 11 19:01:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:22 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.info Jul 11 19:01:22 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:23 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.info" returned: 0 in 0.634s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.369s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.948s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-653702195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0380d9c8-895c-478c-a7df-06fdb627dc39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:15Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Creating volume 0380d9c8-895c-478c-a7df-06fdb627dc39 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:23 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:23 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39 1073741824 Jul 11 19:01:23 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:23 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8d68524d-3f0c-402d-8669-cf5b0e9c6b00 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Create snapshot completed successfully Jul 11 19:01:24 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39 1073741824" returned: 0 in 0.841s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:24 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39 Jul 11 19:01:24 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (73e896b4-163a-485e-ba86-65e03558c93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e71e24d-edf7-4cc4-af69-51ca3ce65d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e71e24d-edf7-4cc4-af69-51ca3ce65d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-686853262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80362e6-040d-4d1c-b6c2-ae681294af5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:25Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b524e970-bafd-410c-9a47-6a5e0c6af3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b524e970-bafd-410c-9a47-6a5e0c6af3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5930de1-6102-4c7d-8b45-a0cedce3c9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5930de1-6102-4c7d-8b45-a0cedce3c9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f80362e6-040d-4d1c-b6c2-ae681294af5a', 'volume_name': 'volume-f80362e6-040d-4d1c-b6c2-ae681294af5a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e3f476-27a8-4a76-a085-8719bc0ae0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e3f476-27a8-4a76-a085-8719bc0ae0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150834e9-036d-425a-a102-20b54a6134c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:24 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume f80362e6-040d-4d1c-b6c2-ae681294af5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f80362e6-040d-4d1c-b6c2-ae681294af5a', 'volume_size': 1} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:24 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39" returned: 0 in 0.693s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.044s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693145973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a84ca38-00ac-4e89-aa37-5eeeacd683ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d82b12fda5a486c8341c3733f41e495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:16Z,use_quota=True,user_id='654156a9517649bb91e6bd098c146b70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Creating volume 2a84ca38-00ac-4e89-aa37-5eeeacd683ab {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:24 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:25 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab 1073741824 Jul 11 19:01:25 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11c1cd3-36c8-43d5-b32e-fd5d6c271d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0380d9c8-895c-478c-a7df-06fdb627dc39', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4113d1-1c64-47a0-93e3-735240495f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (fecbae29-2a23-4546-9083-359f9875c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205ba79b-01d3-456c-9776-63271fd08049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume volume-0380d9c8-895c-478c-a7df-06fdb627dc39 (0380d9c8-895c-478c-a7df-06fdb627dc39): created successfully Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4113d1-1c64-47a0-93e3-735240495f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (6842d423-6638-4846-848f-54bae8a74e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205ba79b-01d3-456c-9776-63271fd08049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217364529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6bdf50-03e7-4d87-afff-73124dd095bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:25Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d440e2bc-c3e9-48b1-96f9-5eb5d17eee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d440e2bc-c3e9-48b1-96f9-5eb5d17eee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f3589f-7f9c-437b-b653-c04d4419098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f3589f-7f9c-437b-b653-c04d4419098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6bdf50-03e7-4d87-afff-73124dd095bb', 'volume_name': 'volume-2d6bdf50-03e7-4d87-afff-73124dd095bb', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d45625-57f5-48a0-a773-d88ce711d0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d45625-57f5-48a0-a773-d88ce711d0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9169367-ced8-43bc-947a-41fc3a6c3a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume 2d6bdf50-03e7-4d87-afff-73124dd095bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6bdf50-03e7-4d87-afff-73124dd095bb', 'volume_size': 1} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:25 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-21050593-eb4a-4382-b16d-e1bf4377ede9 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created volume successfully. Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (e8c95caf-a327-4531-b13c-7da8f0b4913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b13e95-fa62-4b1a-8388-e6b5ee4302b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b13e95-fa62-4b1a-8388-e6b5ee4302b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2104319710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a22fd7-8b15-4c4e-8faf-95e88ec3ee83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:25Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249f400d-8232-4227-9a7f-969398066796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249f400d-8232-4227-9a7f-969398066796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4287a990-e9b5-4ed1-910e-cfb354f10cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4287a990-e9b5-4ed1-910e-cfb354f10cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a22fd7-8b15-4c4e-8faf-95e88ec3ee83', 'volume_name': 'volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1347f4a-13a3-46c8-a482-d8edf60f9275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1347f4a-13a3-46c8-a482-d8edf60f9275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c51192-90bc-445c-a98d-80265e1a74b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:25 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume 84a22fd7-8b15-4c4e-8faf-95e88ec3ee83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83', 'volume_size': 1} Jul 11 19:01:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (cc971f07-1e47-4358-9635-325989b2a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12031316-3261-4ff9-bbe1-a63c9a202910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12031316-3261-4ff9-bbe1-a63c9a202910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353070632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86be5096-85c0-4132-91bb-b63230cfe911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:26Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ed444d-0f52-4c35-bfa0-ff157fa54557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ed444d-0f52-4c35-bfa0-ff157fa54557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e1e0ae-311b-4f35-ae7a-5194f5a64351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e1e0ae-311b-4f35-ae7a-5194f5a64351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86be5096-85c0-4132-91bb-b63230cfe911', 'volume_name': 'volume-86be5096-85c0-4132-91bb-b63230cfe911', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9143f31-712c-4a27-9ef3-3d9db94dff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9143f31-712c-4a27-9ef3-3d9db94dff45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96201bf-9c85-4b32-b387-a2aa69cbbd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume 86be5096-85c0-4132-91bb-b63230cfe911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86be5096-85c0-4132-91bb-b63230cfe911', 'volume_size': 1} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:26 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab 1073741824" returned: 0 in 1.175s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:26 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab Jul 11 19:01:26 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (11e408d6-3d19-4c89-9fb0-589254088302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c05053-5ad7-491e-baf2-acb792386748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c05053-5ad7-491e-baf2-acb792386748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1363089478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ba30a4-4700-427c-9e7f-fa4cacc2078d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:26Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd497515-db88-4dc9-afbc-874b78dd6b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd497515-db88-4dc9-afbc-874b78dd6b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6c87e9-bb54-4d72-be91-03948b454250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6c87e9-bb54-4d72-be91-03948b454250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ba30a4-4700-427c-9e7f-fa4cacc2078d', 'volume_name': 'volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bed202-f12c-4a09-9bb1-300e027c8a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bed202-f12c-4a09-9bb1-300e027c8a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f314d04a-4814-4f81-b984-570b2d261ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume 65ba30a4-4700-427c-9e7f-fa4cacc2078d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d', 'volume_size': 1} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:26 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab" returned: 0 in 0.721s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.525s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf7e38b-c038-4b85-a0a1-9ec502618185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31197e546e1b42ea9a62e0c80691db88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:14Z,use_quota=True,user_id='289196509f5a4260853ae4260edfe448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba1c1e28-d146-4a33-a974-471a496c7fa8),volume_type_id=ba1c1e28-d146-4a33-a974-471a496c7fa8)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Creating volume 5bf7e38b-c038-4b85-a0a1-9ec502618185 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:26 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6316b5b9-4d0a-4df4-a629-a4e2c7f9cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd40e97f-0e0b-41e9-a3b3-eab036e78687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:26 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 1073741824 Jul 11 19:01:26 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:26 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Volume volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab (2a84ca38-00ac-4e89-aa37-5eeeacd683ab): created successfully Jul 11 19:01:26 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd40e97f-0e0b-41e9-a3b3-eab036e78687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Flow 'volume_create_manager' (095b2909-9e22-4843-ba4e-f544547cf33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:27 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6d98605c-f536-43f2-8119-8f5b11e3177d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created volume successfully. Jul 11 19:01:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-2a84ca38-00ac-4e89-aa37-5eeeacd683ab-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-2a84ca38-00ac-4e89-aa37-5eeeacd683ab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:27 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-quobyte-2a84ca38-00ac-4e89-aa37-5eeeacd683ab" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 1073741824" returned: 0 in 0.995s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-2a84ca38-00ac-4e89-aa37-5eeeacd683ab" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:27 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[3172ae14-9e46-4b46-b0f0-4f26f8eff40e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:28 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 Jul 11 19:01:28 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:28 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab Jul 11 19:01:28 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:28 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185" returned: 0 in 0.715s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-686853262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80362e6-040d-4d1c-b6c2-ae681294af5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:25Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Creating volume f80362e6-040d-4d1c-b6c2-ae681294af5a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:28 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:28 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a 1073741824 Jul 11 19:01:28 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Attempting download of 695284a8-4785-4d4c-b5ee-864c442d4d35 ((None, [{'url': 'file:///opt/stack/data/glance/images/695284a8-4785-4d4c-b5ee-864c442d4d35', 'metadata': {}}])) to volume 5bf7e38b-c038-4b85-a0a1-9ec502618185. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 19:01:28 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab" returned: 0 in 0.825s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:28 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab Jul 11 19:01:28 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f31a71e-252d-4b97-9d82-238f548ffecf]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_695284a8-4785-4d4c-b5ee-864c442d4d35__r_jmh4j {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:29 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_695284a8-4785-4d4c-b5ee-864c442d4d35__r_jmh4j Jul 11 19:01:29 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:29 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2a84ca38-00ac-4e89-aa37-5eeeacd683ab" returned: 0 in 0.805s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-2a84ca38-00ac-4e89-aa37-5eeeacd683ab" released by "delete_volume" :: held 1.709s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Flow 'volume_create_manager' (66da080f-7e93-4aa1-9c6d-37c46e3b306a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4573a86a-efad-43af-beda-e690a135d4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:29 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a 1073741824" returned: 0 in 0.986s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:29 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4573a86a-efad-43af-beda-e690a135d4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305761241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0fcf2c8-3987-43fd-85ea-c5810f06f786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0140ff8a50cb44d7be46222bb9f63357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:30Z,use_quota=True,user_id='0f66cf0892af40c5b1ff130eb528d979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99336d1-1b96-46ba-8927-5ec37b0d902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99336d1-1b96-46ba-8927-5ec37b0d902d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd5e4f1-3dbc-4826-b4f6-e7ce65f8cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd5e4f1-3dbc-4826-b4f6-e7ce65f8cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0fcf2c8-3987-43fd-85ea-c5810f06f786', 'volume_name': 'volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96f4fac-2cfe-48ba-9638-64790e333438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96f4fac-2cfe-48ba-9638-64790e333438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811f7680-d38c-482d-b23e-571cd74c57a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:29 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Volume c0fcf2c8-3987-43fd-85ea-c5810f06f786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786', 'volume_size': 1} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_695284a8-4785-4d4c-b5ee-864c442d4d35__r_jmh4j" returned: 0 in 0.941s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_695284a8-4785-4d4c-b5ee-864c442d4d35__r_jmh4j {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created reservations ['9926f535-5fcb-4c55-91a9-9c802148b8e4', 'e13364b0-fe5e-47c4-923e-efd69a7c6849', '6a1a79c5-3eab-4578-89c4-5d017aa56fab', '4797fa92-2317-4ea9-8d0f-4c8066e0f0c4'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:29 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a Jul 11 19:01:29 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:29 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_695284a8-4785-4d4c-b5ee-864c442d4d35__r_jmh4j Jul 11 19:01:29 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:29 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:29 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-0380d9c8-895c-478c-a7df-06fdb627dc39-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-0380d9c8-895c-478c-a7df-06fdb627dc39-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-quobyte-0380d9c8-895c-478c-a7df-06fdb627dc39" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-0380d9c8-895c-478c-a7df-06fdb627dc39" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69e92b7-9f95-40ca-8e5d-4fc4d5ae346b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:30 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39 Jul 11 19:01:30 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:30 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_695284a8-4785-4d4c-b5ee-864c442d4d35__r_jmh4j" returned: 1 in 0.775s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_695284a8-4785-4d4c-b5ee-864c442d4d35__r_jmh4j' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7ac3dd-0ce8-40a3-ba5f-c78b55235f1b]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:30 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD Jul 11 19:01:30 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:30 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.784s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:30 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Deleted volume successfully. Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b7d5342b-aa5f-4003-a019-72cf2f6244b3 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-2a84ca38-00ac-4e89-aa37-5eeeacd683ab-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:30 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a" returned: 0 in 0.893s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.539s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217364529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6bdf50-03e7-4d87-afff-73124dd095bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:25Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Creating volume 2d6bdf50-03e7-4d87-afff-73124dd095bb {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:30 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150834e9-036d-425a-a102-20b54a6134c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f80362e6-040d-4d1c-b6c2-ae681294af5a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:30 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb 1073741824 Jul 11 19:01:30 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703720f5-17c1-460f-aba5-65df020c1df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:30 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume volume-f80362e6-040d-4d1c-b6c2-ae681294af5a (f80362e6-040d-4d1c-b6c2-ae681294af5a): created successfully Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703720f5-17c1-460f-aba5-65df020c1df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (73e896b4-163a-485e-ba86-65e03558c93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:30 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5c28ec41-bdbb-400b-82ed-d6328baf93f8 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created volume successfully. Jul 11 19:01:31 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39" returned: 0 in 0.864s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:31 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39 Jul 11 19:01:31 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:31 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:31 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD Jul 11 19:01:31 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:31 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb 1073741824" returned: 0 in 0.937s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:31 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-0380d9c8-895c-478c-a7df-06fdb627dc39" returned: 0 in 0.694s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:31 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb Jul 11 19:01:31 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-0380d9c8-895c-478c-a7df-06fdb627dc39" released by "delete_volume" :: held 1.613s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created reservations ['a035f5dd-2fc9-4fa4-9ec9-2975c033c447', 'cf12f40b-a20f-415b-b5ea-b0dd57670d24', '141bcfa6-695d-41aa-8445-4fe4f1dd03ce', '4dfac710-ca8e-4ae5-b187-050319328c75'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:31 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:31 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:32 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD" returned: 1 in 0.789s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] 695284a8-4785-4d4c-b5ee-864c442d4d35 was raw, converting to raw {{(pid=87411) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:32 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 Jul 11 19:01:32 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-3d044595-d62d-48e3-b53c-f1711b7a8f79-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-3d044595-d62d-48e3-b53c-f1711b7a8f79-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-quobyte-3d044595-d62d-48e3-b53c-f1711b7a8f79" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:32 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb" returned: 0 in 0.707s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.834s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2104319710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a22fd7-8b15-4c4e-8faf-95e88ec3ee83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:25Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Creating volume 84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:32 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-3d044595-d62d-48e3-b53c-f1711b7a8f79" acquired by "delete_volume" :: waited 0.053s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:32 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 1073741824 Jul 11 19:01:32 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9169367-ced8-43bc-947a-41fc3a6c3a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6bdf50-03e7-4d87-afff-73124dd095bb', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dfa322b-08d5-4405-becc-de260732ad62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6ed57a-e65b-417a-9490-748f0ba04b05]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:32 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume volume-2d6bdf50-03e7-4d87-afff-73124dd095bb (2d6bdf50-03e7-4d87-afff-73124dd095bb): created successfully Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dfa322b-08d5-4405-becc-de260732ad62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (fecbae29-2a23-4546-9083-359f9875c85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:32 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-146ea2a3-c904-4fd0-a24a-b40cad3d3b9c tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created volume successfully. Jul 11 19:01:32 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.713s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:32 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Deleted volume successfully. Jul 11 19:01:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-cdab51ca-34dc-47d1-a1c2-c0cfa48170db tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-0380d9c8-895c-478c-a7df-06fdb627dc39-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:32 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79 Jul 11 19:01:32 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:33 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185" returned: 0 in 0.879s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:33 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_695284a8-4785-4d4c-b5ee-864c442d4d35_p5gv4ufpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:01:33 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 19:01:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:33 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 1G Jul 11 19:01:33 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:33 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 1073741824" returned: 0 in 0.893s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:33 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 Jul 11 19:01:33 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:33 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79" returned: 0 in 0.902s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:33 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79 Jul 11 19:01:33 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:33 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 1G" returned: 0 in 0.749s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:33 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[4378679a-99fc-484e-9aa2-7155fabc4b9f]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:33 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 Jul 11 19:01:33 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:34 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83" returned: 0 in 0.667s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.019s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353070632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86be5096-85c0-4132-91bb-b63230cfe911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:26Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Creating volume 86be5096-85c0-4132-91bb-b63230cfe911 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:34 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:34 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c51192-90bc-445c-a98d-80265e1a74b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de69df8-3931-478c-9354-f599e1e10ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:34 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911 1073741824 Jul 11 19:01:34 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3d044595-d62d-48e3-b53c-f1711b7a8f79" returned: 0 in 0.703s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-3d044595-d62d-48e3-b53c-f1711b7a8f79" released by "delete_volume" :: held 1.664s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:34 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 (84a22fd7-8b15-4c4e-8faf-95e88ec3ee83): created successfully Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de69df8-3931-478c-9354-f599e1e10ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (e8c95caf-a327-4531-b13c-7da8f0b4913a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:34 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-73aa141c-8824-4cfe-8bd3-4fc0c6619cad tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created volume successfully. Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created reservations ['43f24cae-9321-4c1b-9b8d-6df4da7fb360', 'a7a25cbf-c762-4ecc-a117-53f4b60884ac', '5da4e672-f6b6-400e-849a-6036c974e983', '6e425e75-d298-4b53-a774-03ad3c487404'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:34 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:34 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:34 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185" returned: 0 in 0.769s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-quobyte-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:34 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 Jul 11 19:01:34 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb1a35-4c55-4838-9f60-fdc4143f1faa]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:34 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f Jul 11 19:01:34 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:35 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911 1073741824" returned: 0 in 0.967s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:35 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.828s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Deleted volume successfully. Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7ab1c1a6-0b26-4316-b513-df4f8bcb50d8 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-3d044595-d62d-48e3-b53c-f1711b7a8f79-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:35 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911 Jul 11 19:01:35 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:35 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185" returned: 1 in 0.911s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Downloaded image 695284a8-4785-4d4c-b5ee-864c442d4d35 ((None, [{'url': 'file:///opt/stack/data/glance/images/695284a8-4785-4d4c-b5ee-864c442d4d35', 'metadata': {}}])) to volume 5bf7e38b-c038-4b85-a0a1-9ec502618185 successfully. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Temporary image 695284a8-4785-4d4c-b5ee-864c442d4d35 for user 289196509f5a4260853ae4260edfe448 is deleted. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Marking volume 5bf7e38b-c038-4b85-a0a1-9ec502618185 as bootable. {{(pid=87411) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Copying metadata from image 695284a8-4785-4d4c-b5ee-864c442d4d35 to 5bf7e38b-c038-4b85-a0a1-9ec502618185. {{(pid=87411) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Creating volume glance metadata for volume 5bf7e38b-c038-4b85-a0a1-9ec502618185 backed by image 695284a8-4785-4d4c-b5ee-864c442d4d35 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '695284a8-4785-4d4c-b5ee-864c442d4d35', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6dde2771b15cf06581b5f777eb312419', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87411) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1afd66f-ca3b-43a0-87fa-1fb3119a00a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf7e38b-c038-4b85-a0a1-9ec502618185', 'volume_size': 1, 'image_id': '695284a8-4785-4d4c-b5ee-864c442d4d35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/695284a8-4785-4d4c-b5ee-864c442d4d35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6dde2771b15cf06581b5f777eb312419', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31197e546e1b42ea9a62e0c80691db88', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ef0e661a3ad301f4b55592d7a58d23dc0b736954ec14a2f1e0480a6972acd0ae2a6f07f44cb79f150c08cd35afdc5a9fa8b02d0a9bd9c95b54d05badeb2774f', 'id': '695284a8-4785-4d4c-b5ee-864c442d4d35', 'created_at': datetime.datetime(2026, 7, 11, 17, 1, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 1, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/695284a8-4785-4d4c-b5ee-864c442d4d35/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c119f5-bdeb-4ae1-b6cd-09a251ba99e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:35 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Volume volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 (5bf7e38b-c038-4b85-a0a1-9ec502618185): created successfully Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c119f5-bdeb-4ae1-b6cd-09a251ba99e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Flow 'volume_create_manager' (bf547491-2e2f-40d0-aacf-a88217f6a40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-82babe12-7607-45c3-8463-73c627901df2 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Created volume successfully. Jul 11 19:01:35 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f" returned: 0 in 0.912s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:35 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f Jul 11 19:01:35 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:35 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911" returned: 0 in 0.668s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.306s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1363089478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ba30a4-4700-427c-9e7f-fa4cacc2078d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2ba857946a4c058356b8bc3a6d3ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:26Z,use_quota=True,user_id='0847b6d5aed04d2e90aecd0a494e4813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Creating volume 65ba30a4-4700-427c-9e7f-fa4cacc2078d {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:35 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:35 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d 1073741824 Jul 11 19:01:35 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96201bf-9c85-4b32-b387-a2aa69cbbd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86be5096-85c0-4132-91bb-b63230cfe911', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87fed63-55bf-43b7-a1e5-a2d8fb70cdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:35 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume volume-86be5096-85c0-4132-91bb-b63230cfe911 (86be5096-85c0-4132-91bb-b63230cfe911): created successfully Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87fed63-55bf-43b7-a1e5-a2d8fb70cdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (cc971f07-1e47-4358-9635-325989b2a371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8b878a66-6b7c-40e4-8287-c974da5610c2 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created volume successfully. Jul 11 19:01:36 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f" returned: 0 in 0.657s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f" released by "delete_volume" :: held 1.623s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created reservations ['f99a838a-a1e1-4d54-99ac-60a0b224a7af', '2c1d328d-4c6d-4e5b-8198-6e1dae583540', '0faffba0-329e-4687-8952-a0bbea687928', '0d55d729-b45e-4af9-99e5-69a711850837'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Acquiring lock "cinder-5bf7e38b-c038-4b85-a0a1-9ec502618185-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Lock "cinder-5bf7e38b-c038-4b85-a0a1-9ec502618185-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Acquiring lock "cinder-quobyte-5bf7e38b-c038-4b85-a0a1-9ec502618185" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Lock "cinder-quobyte-5bf7e38b-c038-4b85-a0a1-9ec502618185" acquired by "delete_volume" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[583e8d0b-2ce3-4dda-9839-753c65e10d43]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:36 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:36 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:36 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 Jul 11 19:01:36 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:36 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d 1073741824" returned: 0 in 0.891s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:36 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d Jul 11 19:01:36 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-5e8c572f-8441-4eb9-8b09-4cc726ab81d3-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-5e8c572f-8441-4eb9-8b09-4cc726ab81d3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-quobyte-5e8c572f-8441-4eb9-8b09-4cc726ab81d3" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-5e8c572f-8441-4eb9-8b09-4cc726ab81d3" acquired by "delete_volume" :: waited 0.040s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19b5d95-41ba-4653-8af8-7a0db6644944]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:37 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3 Jul 11 19:01:37 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:37 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.728s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:37 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Deleted volume successfully. Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-bae6caa3-2de5-4165-b668-dd416ceebd50 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-e0e01cc6-5d93-4fd5-9bdf-db233bbac41f-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:37 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185" returned: 0 in 0.878s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:37 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d" returned: 0 in 0.767s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.782s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305761241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0fcf2c8-3987-43fd-85ea-c5810f06f786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0140ff8a50cb44d7be46222bb9f63357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:30Z,use_quota=True,user_id='0f66cf0892af40c5b1ff130eb528d979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Creating volume c0fcf2c8-3987-43fd-85ea-c5810f06f786 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:37 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 Jul 11 19:01:37 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:37 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:37 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786 1073741824 Jul 11 19:01:37 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f314d04a-4814-4f81-b984-570b2d261ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d140668-17a9-4d2a-9dbc-2657496c34bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:37 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Volume volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d (65ba30a4-4700-427c-9e7f-fa4cacc2078d): created successfully Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d140668-17a9-4d2a-9dbc-2657496c34bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Flow 'volume_create_manager' (11e408d6-3d19-4c89-9fb0-589254088302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:37 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fccbc182-8b6f-49fc-9b27-0c4efa5e9007 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created volume successfully. Jul 11 19:01:37 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3" returned: 0 in 0.829s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:37 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3 Jul 11 19:01:37 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:38 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185" returned: 1 in 0.851s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:38 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185 Jul 11 19:01:38 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:38 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786 1073741824" returned: 0 in 0.946s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-65ba30a4-4700-427c-9e7f-fa4cacc2078d-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-65ba30a4-4700-427c-9e7f-fa4cacc2078d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:38 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5e8c572f-8441-4eb9-8b09-4cc726ab81d3" returned: 0 in 0.708s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:38 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786 Jul 11 19:01:38 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-5e8c572f-8441-4eb9-8b09-4cc726ab81d3" released by "delete_volume" :: held 1.604s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-quobyte-65ba30a4-4700-427c-9e7f-fa4cacc2078d" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-65ba30a4-4700-427c-9e7f-fa4cacc2078d" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3e37c2-3a3d-4185-a952-b0975ab64ef9]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created reservations ['4469eaf8-39df-4f93-bb8b-8e193c3b672e', 'f7526958-2aee-4f15-80f0-7484db79c323', '20a88000-2cfa-4bcc-9f01-a9514dcfa0d8', '99adea36-1b44-49ce-bee4-28ffe23b4dcd'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:38 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d Jul 11 19:01:38 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:38 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:38 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:39 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-5bf7e38b-c038-4b85-a0a1-9ec502618185" returned: 0 in 0.782s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Lock "cinder-quobyte-5bf7e38b-c038-4b85-a0a1-9ec502618185" released by "delete_volume" :: held 2.601s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Created reservations ['a15b82ed-d4ea-4d09-b384-9b1f93f15ee1', '18b1a1dc-c9ab-4185-8643-752d00082b75', 'eb13b1d2-0bca-4ef8-b440-afdce4753136', 'aec6dc9f-51b9-42b7-bf1d-6c6afdbb985a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-fa397dcd-d130-423a-a20a-3696f3eb479a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-fa397dcd-d130-423a-a20a-3696f3eb479a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:39 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:39 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:39 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786" returned: 0 in 0.797s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "cinder-quobyte-fa397dcd-d130-423a-a20a-3696f3eb479a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811f7680-d38c-482d-b23e-571cd74c57a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2b4c06-3ec8-4381-b64b-a1a156f3cf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-fa397dcd-d130-423a-a20a-3696f3eb479a" acquired by "delete_volume" :: waited 0.049s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:39 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Volume volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786 (c0fcf2c8-3987-43fd-85ea-c5810f06f786): created successfully Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2b4c06-3ec8-4381-b64b-a1a156f3cf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Flow 'volume_create_manager' (66da080f-7e93-4aa1-9c6d-37c46e3b306a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[89be992d-15eb-4613-a692-b2cc064472fb]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:39 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8f37735b-b4cc-445a-86e9-d6bc3ab8fe19 tempest-ProjectReaderTests-1534034527 None] Created volume successfully. Jul 11 19:01:39 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a Jul 11 19:01:39 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:39 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.873s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:39 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:39 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Deleted volume successfully. Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d" returned: 0 in 1.020s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c9dfe37e-3f5e-4ecf-af23-b6a2871ef4f0 tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-5e8c572f-8441-4eb9-8b09-4cc726ab81d3-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:39 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d Jul 11 19:01:39 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:40 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.851s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Deleted volume successfully. Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6795f5cf-4124-4072-af9c-6e2c587625c7 tempest-VolumeAndVolumeTypeFromImageTest-1402855299 None] Lock "cinder-5bf7e38b-c038-4b85-a0a1-9ec502618185-delete_volume" released by "delete_volume" :: held 3.827s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:40 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a" returned: 0 in 0.971s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:40 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a Jul 11 19:01:40 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:40 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-65ba30a4-4700-427c-9e7f-fa4cacc2078d" returned: 0 in 0.781s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-65ba30a4-4700-427c-9e7f-fa4cacc2078d" released by "delete_volume" :: held 1.858s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created reservations ['678fd8ed-5070-44f9-9f18-0143d22093d9', '7486ae8c-e30a-4458-8ad2-ae350c5fb3c9', 'ce2602ab-0e05-4e2c-ad55-aa610d2b0dbd', '6afda0ae-72df-4c19-98b8-269bc014e54c'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Acquiring lock "cinder-c0fcf2c8-3987-43fd-85ea-c5810f06f786-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:40 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:40 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Lock "cinder-c0fcf2c8-3987-43fd-85ea-c5810f06f786-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Acquiring lock "cinder-quobyte-c0fcf2c8-3987-43fd-85ea-c5810f06f786" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-86be5096-85c0-4132-91bb-b63230cfe911-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-86be5096-85c0-4132-91bb-b63230cfe911-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Lock "cinder-quobyte-c0fcf2c8-3987-43fd-85ea-c5810f06f786" acquired by "delete_volume" :: waited 0.045s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efba8d1-b820-4641-ac1b-ce11462c4f5e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-quobyte-86be5096-85c0-4132-91bb-b63230cfe911" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-86be5096-85c0-4132-91bb-b63230cfe911" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a42e077-8c0c-4aec-9f62-5e502fef3d5f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:41 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786 Jul 11 19:01:41 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:41 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911 Jul 11 19:01:41 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:41 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-fa397dcd-d130-423a-a20a-3696f3eb479a" returned: 0 in 1.095s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-quobyte-fa397dcd-d130-423a-a20a-3696f3eb479a" released by "delete_volume" :: held 2.141s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Created reservations ['bd475e1e-53c3-481c-a29a-2e3d2986eda9', '2ca7eb72-c172-4cb3-84f5-fb31781216fa', '2ebf933d-4b73-4f61-80ec-72220ea718fc', '2204414d-2bac-4943-b311-c44a0887089a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:41 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.062s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:41 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Deleted volume successfully. Jul 11 19:01:41 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:41 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e21dfe3f-1e1f-4695-ab87-cc730c86cf31 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-65ba30a4-4700-427c-9e7f-fa4cacc2078d-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:42 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911" returned: 0 in 1.010s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:42 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911 Jul 11 19:01:42 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:42 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786" returned: 0 in 1.154s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:42 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786 Jul 11 19:01:42 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:42 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.766s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:42 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:42 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Deleted volume successfully. Jul 11 19:01:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f1da777-032c-4e0d-b201-d52bae924e4d tempest-CreateVolumesFromSourceVolumeTest-1121295092 None] Lock "cinder-fa397dcd-d130-423a-a20a-3696f3eb479a-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:42 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-c0fcf2c8-3987-43fd-85ea-c5810f06f786" returned: 0 in 0.769s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Lock "cinder-quobyte-c0fcf2c8-3987-43fd-85ea-c5810f06f786" released by "delete_volume" :: held 1.999s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:43 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Created reservations ['8430c836-281b-4f54-93be-23b299f28377', 'a5eab3c0-0647-4e48-9041-f83d1c7748db', '228799b6-2b27-4608-9d1e-d1302f87c21d', 'e69acd5a-c7e3-4e2b-8d09-8777ef9bad29'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-86be5096-85c0-4132-91bb-b63230cfe911" returned: 0 in 0.916s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-86be5096-85c0-4132-91bb-b63230cfe911" released by "delete_volume" :: held 1.991s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:43 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:43 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created reservations ['4a32413c-2511-4ea3-99c0-62b2e802878d', '73ffe03b-4a77-4b77-80fc-7fea08c5c6ae', '25465902-1f31-4deb-bbd1-42d0e373e70d', '2f65e2ac-5099-46ca-be61-76b926479f66'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:43 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:43 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:43 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.816s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:43 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:43 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Deleted volume successfully. Jul 11 19:01:44 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.720s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f657b293-302e-42a7-a38e-6560d785371b tempest-ProjectReaderTests-1534034527 None] Lock "cinder-c0fcf2c8-3987-43fd-85ea-c5810f06f786-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Deleted volume successfully. Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-72c290bb-4638-4151-8a44-b13cf14d76fe tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-86be5096-85c0-4132-91bb-b63230cfe911-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-quobyte-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83" acquired by "delete_volume" :: waited 0.035s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[86114482-d292-4b79-a78e-9ffb597a4e3d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:44 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 Jul 11 19:01:44 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Flow 'volume_create_manager' (6682e945-c940-4899-bc2c-04d88593ea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a657c3c0-76bf-47b7-a99f-e6f60a0c4202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a657c3c0-76bf-47b7-a99f-e6f60a0c4202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409624480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dc518e-6c87-4bf1-95c4-fa54c51cc26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0140ff8a50cb44d7be46222bb9f63357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:45Z,use_quota=True,user_id='0f66cf0892af40c5b1ff130eb528d979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eece6cb-2ef0-4eb0-965f-f621cfda2183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eece6cb-2ef0-4eb0-965f-f621cfda2183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fbe90f-9237-4362-be3b-9f1b493f1f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fbe90f-9237-4362-be3b-9f1b493f1f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6dc518e-6c87-4bf1-95c4-fa54c51cc26a', 'volume_name': 'volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c803246-5f11-4256-a909-04173d55fd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c803246-5f11-4256-a909-04173d55fd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c089c894-c11d-432c-8d14-8b130d02a250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:44 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Volume d6dc518e-6c87-4bf1-95c4-fa54c51cc26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a', 'volume_size': 1} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409624480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dc518e-6c87-4bf1-95c4-fa54c51cc26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0140ff8a50cb44d7be46222bb9f63357',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:45Z,use_quota=True,user_id='0f66cf0892af40c5b1ff130eb528d979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Creating volume d6dc518e-6c87-4bf1-95c4-fa54c51cc26a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:44 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:44 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a 1073741824 Jul 11 19:01:44 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:45 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83" returned: 0 in 0.945s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:45 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83 Jul 11 19:01:45 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:45 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a 1073741824" returned: 0 in 0.977s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:45 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a Jul 11 19:01:45 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Flow 'volume_create_manager' (f8149470-bd93-4404-aa1a-a0add0a54ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c58099-f414-44d6-9710-9f42d60625eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c58099-f414-44d6-9710-9f42d60625eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021333492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c4a196-86bd-4414-adb2-7e012df55f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fcb4b6bfe34230bccd90b17ab906d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:46Z,use_quota=True,user_id='1c095fb447b1497582509e166e58c8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6feaa7-c22d-4649-adbb-2143ccf4e633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6feaa7-c22d-4649-adbb-2143ccf4e633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40aff17b-b70e-46b4-89bf-ecd56089ac33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40aff17b-b70e-46b4-89bf-ecd56089ac33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c4a196-86bd-4414-adb2-7e012df55f2b', 'volume_name': 'volume-a6c4a196-86bd-4414-adb2-7e012df55f2b', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c134ac8-1199-458e-a950-fa154767b843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c134ac8-1199-458e-a950-fa154767b843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6ffe81-33e2-48f1-ba5d-0e8e00aba2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:46 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Volume a6c4a196-86bd-4414-adb2-7e012df55f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c4a196-86bd-4414-adb2-7e012df55f2b', 'volume_size': 1} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:46 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83" returned: 0 in 0.848s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83" released by "delete_volume" :: held 1.869s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created reservations ['aa9803aa-c2ae-4093-b654-89d7c6a7e9dc', 'be862a5e-8dde-43e7-9004-f73c5138b018', 'cd34949b-2388-4f97-8f44-bb450d08eaac', '5df6164a-6a43-4851-932d-2689031044e3'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:46 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:46 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:46 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a" returned: 0 in 0.873s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021333492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c4a196-86bd-4414-adb2-7e012df55f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fcb4b6bfe34230bccd90b17ab906d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:46Z,use_quota=True,user_id='1c095fb447b1497582509e166e58c8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Creating volume a6c4a196-86bd-4414-adb2-7e012df55f2b {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:46 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-2d6bdf50-03e7-4d87-afff-73124dd095bb-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:46 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b 1073741824 Jul 11 19:01:46 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c089c894-c11d-432c-8d14-8b130d02a250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc513d04-f39f-487f-91e9-3c23c0d24920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:46 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Volume volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a (d6dc518e-6c87-4bf1-95c4-fa54c51cc26a): created successfully Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc513d04-f39f-487f-91e9-3c23c0d24920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Flow 'volume_create_manager' (6682e945-c940-4899-bc2c-04d88593ea4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-2d6bdf50-03e7-4d87-afff-73124dd095bb-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Flow 'volume_create_manager' (1c33627b-8ef7-48a5-97f0-9b2274ee62f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0587ec27-bca5-4151-93ef-149be66d16a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:46 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-9faa2c98-b389-4721-9a71-9ddf80ec3508 tempest-ProjectReaderTests-1534034527 None] Created volume successfully. Jul 11 19:01:46 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0587ec27-bca5-4151-93ef-149be66d16a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-550794146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4712e22-3ba3-4b8b-84e9-b95e6ded0e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fcb4b6bfe34230bccd90b17ab906d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:47Z,use_quota=True,user_id='1c095fb447b1497582509e166e58c8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf54c2b-2efc-4b07-aea0-dddbb38a6f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf54c2b-2efc-4b07-aea0-dddbb38a6f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a17a2c4-6492-4b25-8a11-571f3281aa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a17a2c4-6492-4b25-8a11-571f3281aa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4712e22-3ba3-4b8b-84e9-b95e6ded0e21', 'volume_name': 'volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45122864-3ef2-4140-9e63-b761c4a1d02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45122864-3ef2-4140-9e63-b761c4a1d02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb9d55e-9715-4b80-8187-8b3529a03fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Volume d4712e22-3ba3-4b8b-84e9-b95e6ded0e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21', 'volume_size': 1} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-quobyte-2d6bdf50-03e7-4d87-afff-73124dd095bb" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-2d6bdf50-03e7-4d87-afff-73124dd095bb" acquired by "delete_volume" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a1e9ac-6fd7-42a7-b652-842646b581c1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Flow 'volume_create_manager' (46fb3260-7900-4315-8b03-675435d2f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65f1367-b67c-48c0-9280-fa6a19b4ea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65f1367-b67c-48c0-9280-fa6a19b4ea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-831580838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81df8345-d71a-4ea6-a0af-e9bb3d5c684a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17033af24aba4862a401952961370369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:47Z,use_quota=True,user_id='c67058e273344da7a942f58e6e13c7bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec72add-8d2e-4c6e-85b8-d3a9ba5dd335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec72add-8d2e-4c6e-85b8-d3a9ba5dd335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7206b032-66be-4866-aac8-dba11f06dc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7206b032-66be-4866-aac8-dba11f06dc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81df8345-d71a-4ea6-a0af-e9bb3d5c684a', 'volume_name': 'volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697896d0-a97a-439e-a9ae-3e9e28ba083f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697896d0-a97a-439e-a9ae-3e9e28ba083f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f415c061-c35a-4bd9-a011-69d4538666d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Volume 81df8345-d71a-4ea6-a0af-e9bb3d5c684a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a', 'volume_size': 1} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:47 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb Jul 11 19:01:47 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Flow 'volume_create_manager' (5fa3a006-9e85-4752-a43a-a464815f7986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11cb93b-a594-4bdf-8d18-5242ace6e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11cb93b-a594-4bdf-8d18-5242ace6e349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-117083483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8371fdb6-661b-447e-9893-bb8c3f196e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fcb4b6bfe34230bccd90b17ab906d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:47Z,use_quota=True,user_id='1c095fb447b1497582509e166e58c8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3612a37f-9285-4685-ae75-b81c14ae3d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3612a37f-9285-4685-ae75-b81c14ae3d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e195f7d-7495-442f-9063-898282446b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e195f7d-7495-442f-9063-898282446b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8371fdb6-661b-447e-9893-bb8c3f196e73', 'volume_name': 'volume-8371fdb6-661b-447e-9893-bb8c3f196e73', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d2e552-5f39-446b-9d0d-971f7070c65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d2e552-5f39-446b-9d0d-971f7070c65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daac474-4998-4855-9b4b-2f400a80cb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:47 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Volume 8371fdb6-661b-447e-9893-bb8c3f196e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8371fdb6-661b-447e-9893-bb8c3f196e73', 'volume_size': 1} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:47 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.046s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Deleted volume successfully. Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-0f52df2f-bb30-4ad1-b7d2-801d3272a643 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-84a22fd7-8b15-4c4e-8faf-95e88ec3ee83-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:47 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:47 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Flow 'volume_create_manager' (9d31391c-1fbb-4c06-9238-f223554cbb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39305fa0-9d08-4048-a348-7271e6cfd000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b 1073741824" returned: 0 in 1.237s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39305fa0-9d08-4048-a348-7271e6cfd000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1336195150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7a2ab9-386c-4019-a208-cf813c39ca4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fcb4b6bfe34230bccd90b17ab906d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:48Z,use_quota=True,user_id='1c095fb447b1497582509e166e58c8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a8242e-b863-4147-a80c-99c80794c523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a8242e-b863-4147-a80c-99c80794c523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab833a6-9754-4770-bb9c-495f6eab5447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab833a6-9754-4770-bb9c-495f6eab5447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf7a2ab9-386c-4019-a208-cf813c39ca4f', 'volume_name': 'volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e293960-3e19-401c-ac97-691bf12d9abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e293960-3e19-401c-ac97-691bf12d9abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08017389-89a6-4251-a3a3-c84c10ac1e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Volume cf7a2ab9-386c-4019-a208-cf813c39ca4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f', 'volume_size': 1} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:48 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b Jul 11 19:01:48 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:48 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb" returned: 0 in 1.062s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Acquiring lock "cinder-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:48 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb Jul 11 19:01:48 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Lock "cinder-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Acquiring lock "cinder-quobyte-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Lock "cinder-quobyte-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c16b35-bb51-43f9-a3e2-21f8789e332f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:01:48 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a Jul 11 19:01:48 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Flow 'volume_create_manager' (72dc9969-302d-4064-8a8b-5408e8938a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd812d37-7303-41b7-80aa-d866c6cda27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd812d37-7303-41b7-80aa-d866c6cda27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372973035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9114215-a5f8-4920-ab50-00d32907edc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fcb4b6bfe34230bccd90b17ab906d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:48Z,use_quota=True,user_id='1c095fb447b1497582509e166e58c8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e25af7-1e52-4a6b-936a-d940b6cbf20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e25af7-1e52-4a6b-936a-d940b6cbf20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb95ecd9-a0c5-4e1b-a3a6-1f5102af7522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb95ecd9-a0c5-4e1b-a3a6-1f5102af7522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9114215-a5f8-4920-ab50-00d32907edc6', 'volume_name': 'volume-b9114215-a5f8-4920-ab50-00d32907edc6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f029283-8db3-4757-afe0-7249ab339e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f029283-8db3-4757-afe0-7249ab339e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63aa21e-5b47-4d75-8220-62fbf6655de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Volume b9114215-a5f8-4920-ab50-00d32907edc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9114215-a5f8-4920-ab50-00d32907edc6', 'volume_size': 1} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:48 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b" returned: 0 in 0.685s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.772s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-550794146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4712e22-3ba3-4b8b-84e9-b95e6ded0e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fcb4b6bfe34230bccd90b17ab906d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:47Z,use_quota=True,user_id='1c095fb447b1497582509e166e58c8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Creating volume d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:48 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:48 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 1073741824 Jul 11 19:01:48 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6ffe81-33e2-48f1-ba5d-0e8e00aba2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c4a196-86bd-4414-adb2-7e012df55f2b', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d227bf8-0a71-4877-a9e4-c8139df4329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:48 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Volume volume-a6c4a196-86bd-4414-adb2-7e012df55f2b (a6c4a196-86bd-4414-adb2-7e012df55f2b): created successfully Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d227bf8-0a71-4877-a9e4-c8139df4329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Flow 'volume_create_manager' (f8149470-bd93-4404-aa1a-a0add0a54ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:48 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1b1b1014-4756-4c00-a63d-b4d4d2697173 tempest-CreateVolumesFromImageTest-110140363 None] Created volume successfully. Jul 11 19:01:49 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2d6bdf50-03e7-4d87-afff-73124dd095bb" returned: 0 in 0.823s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-2d6bdf50-03e7-4d87-afff-73124dd095bb" released by "delete_volume" :: held 1.944s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created reservations ['578631a9-ca61-4aee-a9fd-4d9a5d0765ac', 'a7e7ff58-c79a-43c0-8025-54d0f81a8f47', '376ac7ca-fd1c-4758-ad83-90acad8053a3', '3a344688-bcb2-4713-8b7a-018f94cd42d7'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:49 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:49 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-f80362e6-040d-4d1c-b6c2-ae681294af5a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-f80362e6-040d-4d1c-b6c2-ae681294af5a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:49 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a" returned: 0 in 0.900s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:49 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a Jul 11 19:01:49 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-quobyte-f80362e6-040d-4d1c-b6c2-ae681294af5a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-f80362e6-040d-4d1c-b6c2-ae681294af5a" acquired by "delete_volume" :: waited 0.034s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb125a69-3b7b-4df6-ab4f-12a5d0acb727]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:49 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a Jul 11 19:01:49 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:49 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 1073741824" returned: 0 in 0.975s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:49 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 Jul 11 19:01:49 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:49 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.725s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:49 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Deleted volume successfully. Jul 11 19:01:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2660a18c-a81f-4dd3-bf49-47285f0e6702 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-2d6bdf50-03e7-4d87-afff-73124dd095bb-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:50 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a" returned: 0 in 0.853s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Lock "cinder-quobyte-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a" released by "delete_volume" :: held 1.808s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Created reservations ['95369cf3-40b1-4de4-9a3a-3ce1fabbd258', '8c86579a-c4d0-4ca4-b3ca-0900eb0cb45a', '797ccb56-6ec6-4bdd-8174-a72b4f127e24', 'ea954593-1d85-49ee-b7b2-b03c5982184a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:50 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a" returned: 0 in 0.827s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:50 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a Jul 11 19:01:50 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:50 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:50 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:50 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21" returned: 0 in 0.707s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.307s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-831580838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81df8345-d71a-4ea6-a0af-e9bb3d5c684a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17033af24aba4862a401952961370369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:47Z,use_quota=True,user_id='c67058e273344da7a942f58e6e13c7bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Creating volume 81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:50 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:50 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a 1073741824 Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb9d55e-9715-4b80-8187-8b3529a03fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:50 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169aec5a-40d9-41e2-aba9-c0fabab7b12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Volume volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 (d4712e22-3ba3-4b8b-84e9-b95e6ded0e21): created successfully Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169aec5a-40d9-41e2-aba9-c0fabab7b12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Flow 'volume_create_manager' (1c33627b-8ef7-48a5-97f0-9b2274ee62f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:50 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3508a8ae-53bd-49ad-ba5b-090b7026b369 tempest-CreateVolumesFromImageTest-110140363 None] Created volume successfully. Jul 11 19:01:51 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f80362e6-040d-4d1c-b6c2-ae681294af5a" returned: 0 in 0.745s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-f80362e6-040d-4d1c-b6c2-ae681294af5a" released by "delete_volume" :: held 1.651s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:51 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.775s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Deleted volume successfully. Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f989f16b-7551-4a65-8f3c-0bdca8f5185d tempest-ProjectReaderTests-1534034527 None] Lock "cinder-d6dc518e-6c87-4bf1-95c4-fa54c51cc26a-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created reservations ['bb9039ea-c2ac-4c2b-afc6-2dbd6b66be45', '2124f650-1475-4a3e-b161-1f9b8515ff09', 'c2dfb09f-2886-4f17-9d22-534d5290f22b', 'd7cbcb2c-de82-4370-8702-914e4de4f7f4'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:51 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:51 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:51 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:51 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-c802db57-b44f-4735-90e6-3e26b9724849-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-c802db57-b44f-4735-90e6-3e26b9724849-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-quobyte-d37d1b20-0217-47d4-96cc-48f8864cc89b" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-d37d1b20-0217-47d4-96cc-48f8864cc89b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-quobyte-c802db57-b44f-4735-90e6-3e26b9724849" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-c802db57-b44f-4735-90e6-3e26b9724849" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Deleting offline snapshot c802db57-b44f-4735-90e6-3e26b9724849 of volume d37d1b20-0217-47d4-96cc-48f8864cc89b {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] snapshot_file for this snap is: volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[613e3319-428a-4ac0-932b-839c44440bed]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:51 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a 1073741824" returned: 0 in 1.195s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:51 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 Jul 11 19:01:51 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:51 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a Jul 11 19:01:51 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:52 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.966s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:52 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Deleted volume successfully. Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-6ec682bd-045f-42c5-82fc-a1eba60c46ed tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-f80362e6-040d-4d1c-b6c2-ae681294af5a-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:52 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.907s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:01:52 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" returned: 0 in 0.836s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.111s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-117083483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8371fdb6-661b-447e-9893-bb8c3f196e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fcb4b6bfe34230bccd90b17ab906d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:47Z,use_quota=True,user_id='1c095fb447b1497582509e166e58c8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Creating volume 8371fdb6-661b-447e-9893-bb8c3f196e73 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:52 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:52 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849" returned: 0 in 1.045s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d37d1b20-0217-47d4-96cc-48f8864cc89b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:01:52 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73 1073741824 Jul 11 19:01:52 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f415c061-c35a-4bd9-a011-69d4538666d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868135e8-4555-43cc-900c-9c9e3a9fc1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[122fd30e-f317-4dbe-92e4-1e7f41d758f1]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:52 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Volume volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a (81df8345-d71a-4ea6-a0af-e9bb3d5c684a): created successfully Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868135e8-4555-43cc-900c-9c9e3a9fc1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Flow 'volume_create_manager' (46fb3260-7900-4315-8b03-675435d2f55f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:52 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2d7de52c-ed9b-4935-881d-fbc386a3f5c5 tempest-VolumeDependencyTests-1331781260 None] Created volume successfully. Jul 11 19:01:52 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b Jul 11 19:01:52 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:53 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b" returned: 0 in 0.891s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:53 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73 1073741824" returned: 0 in 0.978s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:53 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 Jul 11 19:01:53 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:53 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73 Jul 11 19:01:53 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:54 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73" returned: 0 in 0.660s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.295s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1336195150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7a2ab9-386c-4019-a208-cf813c39ca4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fcb4b6bfe34230bccd90b17ab906d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:48Z,use_quota=True,user_id='1c095fb447b1497582509e166e58c8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Creating volume cf7a2ab9-386c-4019-a208-cf813c39ca4f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:54 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daac474-4998-4855-9b4b-2f400a80cb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8371fdb6-661b-447e-9893-bb8c3f196e73', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:54 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f 1073741824 Jul 11 19:01:54 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1c0862-826d-4f00-a83f-036f4b04e7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:54 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849" returned: 0 in 0.788s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:54 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Volume volume-8371fdb6-661b-447e-9893-bb8c3f196e73 (8371fdb6-661b-447e-9893-bb8c3f196e73): created successfully Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1c0862-826d-4f00-a83f-036f4b04e7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Flow 'volume_create_manager' (5fa3a006-9e85-4752-a43a-a464815f7986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:54 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849 Jul 11 19:01:54 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:54 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-91ebf81f-f9ba-40b6-b59f-f15e052ee413 tempest-CreateVolumesFromImageTest-110140363 None] Created volume successfully. Jul 11 19:01:55 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b.c802db57-b44f-4735-90e6-3e26b9724849" returned: 0 in 0.692s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-c802db57-b44f-4735-90e6-3e26b9724849" released by "_delete_snapshot" :: held 3.576s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-d37d1b20-0217-47d4-96cc-48f8864cc89b" released by "delete_snapshot" :: held 3.617s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created reservations ['2fcf185d-c9b2-47b5-a7ae-33a1b5ee4d5d', 'fe418454-c176-4ab5-ad21-38d8b51ba1a4', '4e5c9ee8-6faf-4d08-8313-d6781b6c8d0f', 'c30e499c-3e4d-420a-9e39-7162b438f870'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Delete snapshot completed successfully. Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-96bb05e7-6bb9-4d69-bdd7-dbe8711f1290 tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-c802db57-b44f-4735-90e6-3e26b9724849-delete_snapshot" released by "delete_snapshot" :: held 3.780s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:55 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f 1073741824" returned: 0 in 0.979s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:55 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f Jul 11 19:01:55 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-d37d1b20-0217-47d4-96cc-48f8864cc89b-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-d37d1b20-0217-47d4-96cc-48f8864cc89b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "cinder-quobyte-d37d1b20-0217-47d4-96cc-48f8864cc89b" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-d37d1b20-0217-47d4-96cc-48f8864cc89b" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[393c400d-a74e-4063-906d-385ac2a90b7f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:56 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f" returned: 0 in 0.668s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.501s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372973035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9114215-a5f8-4920-ab50-00d32907edc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93fcb4b6bfe34230bccd90b17ab906d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:01:48Z,use_quota=True,user_id='1c095fb447b1497582509e166e58c8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Creating volume b9114215-a5f8-4920-ab50-00d32907edc6 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:56 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b Jul 11 19:01:56 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:01:56 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:56 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6 1073741824 Jul 11 19:01:56 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08017389-89a6-4251-a3a3-c84c10ac1e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb0dca9-dc15-4a06-addc-c16fe232ea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:56 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Volume volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f (cf7a2ab9-386c-4019-a208-cf813c39ca4f): created successfully Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb0dca9-dc15-4a06-addc-c16fe232ea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Flow 'volume_create_manager' (9d31391c-1fbb-4c06-9238-f223554cbb40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:56 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8d4975e6-35b8-45b9-a144-424100586ce0 tempest-CreateVolumesFromImageTest-110140363 None] Created volume successfully. Jul 11 19:01:56 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b" returned: 0 in 0.992s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:57 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b Jul 11 19:01:57 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:57 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6 1073741824" returned: 0 in 0.992s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:57 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6 Jul 11 19:01:57 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:57 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d37d1b20-0217-47d4-96cc-48f8864cc89b" returned: 0 in 0.768s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-quobyte-d37d1b20-0217-47d4-96cc-48f8864cc89b" released by "delete_volume" :: held 1.845s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Created reservations ['32f87f80-8f74-4769-80ed-a286eab6fd02', '44e49cb8-3795-4beb-860e-d22f27b69909', '003c290f-2a78-49f6-a20c-2ec987d0ade7', 'df65fb2c-0227-4f6b-b5c5-e7005ddb0a77'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:01:57 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6" returned: 0 in 0.737s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.279s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Creating offline snapshot af64dfaf-8568-4281-92af-563da9ce13a4 of volume 81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63aa21e-5b47-4d75-8220-62fbf6655de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9114215-a5f8-4920-ab50-00d32907edc6', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c572518d-2c65-4984-8b6a-4f8ae30d1ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[717ec0ea-89b2-4c1d-b9fa-30c58e09a926]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:57 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Volume volume-b9114215-a5f8-4920-ab50-00d32907edc6 (b9114215-a5f8-4920-ab50-00d32907edc6): created successfully Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c572518d-2c65-4984-8b6a-4f8ae30d1ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Flow 'volume_create_manager' (72dc9969-302d-4064-8a8b-5408e8938a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:01:57 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-af6cb26f-a330-4865-9d4b-387fc8f36dd1 tempest-CreateVolumesFromImageTest-110140363 None] Created volume successfully. Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:01:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:58 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:01:58 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:58 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a Jul 11 19:01:58 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:58 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.715s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:01:58 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Deleted volume successfully. Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "cinder-b9114215-a5f8-4920-ab50-00d32907edc6-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-b9114215-a5f8-4920-ab50-00d32907edc6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-12e238d7-be75-4a6f-8ee3-1a1ea6da34cc tempest-CreateVolumesFromSnapshotTest-1127530978 None] Lock "cinder-d37d1b20-0217-47d4-96cc-48f8864cc89b-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "cinder-quobyte-b9114215-a5f8-4920-ab50-00d32907edc6" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:01:58 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" returned: 0 in 0.934s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-quobyte-b9114215-a5f8-4920-ab50-00d32907edc6" acquired by "delete_volume" :: waited 0.038s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:01:58 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 1G Jul 11 19:01:58 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[0876261a-f841-4081-bede-fc072754e4ff]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:01:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:59 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6 Jul 11 19:01:59 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:59 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 1G" returned: 0 in 0.973s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:59 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 11 19:01:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6" returned: 0 in 0.947s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:01:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:01:59 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 Jul 11 19:01:59 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:01:59 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6 Jul 11 19:01:59 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:00 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b9114215-a5f8-4920-ab50-00d32907edc6" returned: 0 in 0.791s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:00 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4" returned: 0 in 0.849s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:00 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 is being set with open permissions: ugo+rw Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-quobyte-b9114215-a5f8-4920-ab50-00d32907edc6" released by "delete_volume" :: held 1.816s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:00 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 Jul 11 19:02:00 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Created reservations ['02695921-f539-430a-8542-72e885fc2b52', '5846e13d-522f-4fbb-83ba-7955af2b0b84', 'a6ce41b7-bbb1-46f8-b349-a8c07776af4d', '5ecdfe15-a79a-4323-80dc-c12f5b08e67e'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:00 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:00 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "cinder-cf7a2ab9-386c-4019-a208-cf813c39ca4f-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-cf7a2ab9-386c-4019-a208-cf813c39ca4f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=147,cinder:INSERT=45,cinder:UPDATE=189,cinder:DELETE=17 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "cinder-quobyte-cf7a2ab9-386c-4019-a208-cf813c39ca4f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-quobyte-cf7a2ab9-386c-4019-a208-cf813c39ca4f" acquired by "delete_volume" :: waited 0.035s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9e2fa9-50a2-4356-b64c-ed14c1866ece]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:01 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f Jul 11 19:02:01 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:01 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4" returned: 0 in 0.898s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:01 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.info Jul 11 19:02:01 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:01 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 1.036s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:01 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Deleted volume successfully. Jul 11 19:02:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3d8fbc18-9095-4d66-a9fd-92da321d0d22 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-b9114215-a5f8-4920-ab50-00d32907edc6-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=134,cinder:UPDATE=215,cinder:DELETE=20,cinder:INSERT=56 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Flow 'volume_create_manager' (b5672248-e9ed-4cce-b8be-f95d189bd9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be12d73-2211-4ffa-b3f2-7170fac418fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be12d73-2211-4ffa-b3f2-7170fac418fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019cc3cc-419f-4aed-bbe3-6c2db36523f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bd6ae6dab4bfd80ff8df25d5d94b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:02Z,use_quota=True,user_id='c7fc2a179bed4970a62f9027a8ad9985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fffad4-2262-4ba0-8f79-c547d732d0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fffad4-2262-4ba0-8f79-c547d732d0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba185ca3-87a1-4a44-9e30-a1c7df0dcc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba185ca3-87a1-4a44-9e30-a1c7df0dcc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '019cc3cc-419f-4aed-bbe3-6c2db36523f5', 'volume_name': 'volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b1aa01-f894-4c50-8689-11d3c6b1d994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b1aa01-f894-4c50-8689-11d3c6b1d994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8baa66-e3b4-46ef-bbdf-005f3dc5edf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:02 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Volume 019cc3cc-419f-4aed-bbe3-6c2db36523f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5', 'volume_size': 1} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:02 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f" returned: 0 in 1.127s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:02 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f Jul 11 19:02:02 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:02 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.info" returned: 0 in 0.826s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:02 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.info is being set with open permissions: ugo+rw Jul 11 19:02:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:02 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.info Jul 11 19:02:02 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:03 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf7a2ab9-386c-4019-a208-cf813c39ca4f" returned: 0 in 0.672s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-quobyte-cf7a2ab9-386c-4019-a208-cf813c39ca4f" released by "delete_volume" :: held 1.876s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Created reservations ['396dbb71-f316-484d-bb79-8415f586999a', 'ce353678-5c8a-4df9-8c6a-ead6b03f78c3', '6421ed33-6e88-48ff-9915-62c954346565', 'c9d799fc-1031-4008-9eca-32f02fe25fc8'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:03 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.info" returned: 0 in 0.686s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.293s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.827s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019cc3cc-419f-4aed-bbe3-6c2db36523f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bd6ae6dab4bfd80ff8df25d5d94b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:02Z,use_quota=True,user_id='c7fc2a179bed4970a62f9027a8ad9985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Creating volume 019cc3cc-419f-4aed-bbe3-6c2db36523f5 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:02:03 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:03 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5 1073741824 Jul 11 19:02:03 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:03 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-685680ae-fc72-4925-ac17-e9aa29783cff tempest-VolumeDependencyTests-1331781260 None] Create snapshot completed successfully Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:03 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:03 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "cinder-8371fdb6-661b-447e-9893-bb8c3f196e73-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-8371fdb6-661b-447e-9893-bb8c3f196e73-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "cinder-quobyte-8371fdb6-661b-447e-9893-bb8c3f196e73" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-quobyte-8371fdb6-661b-447e-9893-bb8c3f196e73" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[79937869-3c20-440c-a0cf-7f2300b41a7f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:03 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73 Jul 11 19:02:03 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:04 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.950s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:04 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:04 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Deleted volume successfully. Jul 11 19:02:04 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5 1073741824" returned: 0 in 1.110s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a7e91880-946d-4dc9-8af3-a8a71660e2be tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-cf7a2ab9-386c-4019-a208-cf813c39ca4f-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:04 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5 Jul 11 19:02:04 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:04 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73" returned: 0 in 1.127s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:04 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73 Jul 11 19:02:04 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Flow 'volume_create_manager' (1f1cdae8-3088-4468-828b-5d0957fc5672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3ed720-6578-45ba-a14e-10379ec31839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3ed720-6578-45ba-a14e-10379ec31839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934592085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc048c1e-dd22-4e74-8afd-68416cc7143a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17033af24aba4862a401952961370369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=af64dfaf-8568-4281-92af-563da9ce13a4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:05Z,use_quota=True,user_id='c67058e273344da7a942f58e6e13c7bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c0bcd26-b873-43a6-ad86-eeeb86aef6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c0bcd26-b873-43a6-ad86-eeeb86aef6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef11581-294f-472b-b7d0-a6dd095bcc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef11581-294f-472b-b7d0-a6dd095bcc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc048c1e-dd22-4e74-8afd-68416cc7143a', 'volume_name': 'volume-dc048c1e-dd22-4e74-8afd-68416cc7143a', 'volume_size': 1, 'snapshot_id': 'af64dfaf-8568-4281-92af-563da9ce13a4'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968c7844-581d-4eb1-9a18-511c818ad9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968c7844-581d-4eb1-9a18-511c818ad9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485f9df3-726e-42e4-b217-8ce41a227a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:05 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Volume dc048c1e-dd22-4e74-8afd-68416cc7143a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc048c1e-dd22-4e74-8afd-68416cc7143a', 'volume_size': 1, 'snapshot_id': 'af64dfaf-8568-4281-92af-563da9ce13a4'} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:05 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5" returned: 0 in 0.897s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.103s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "cinder-quobyte-af64dfaf-8568-4281-92af-563da9ce13a4-dc048c1e-dd22-4e74-8afd-68416cc7143a" by "_create_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-af64dfaf-8568-4281-92af-563da9ce13a4-dc048c1e-dd22-4e74-8afd-68416cc7143a" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Creating volume dc048c1e-dd22-4e74-8afd-68416cc7143a from snapshot af64dfaf-8568-4281-92af-563da9ce13a4 {{(pid=87411) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "cinder-quobyte-dc048c1e-dd22-4e74-8afd-68416cc7143a" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8baa66-e3b4-46ef-bbdf-005f3dc5edf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49849611-ce3d-4685-895d-99cbd22cdeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-dc048c1e-dd22-4e74-8afd-68416cc7143a" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] snapshot: af64dfaf-8568-4281-92af-563da9ce13a4, volume: dc048c1e-dd22-4e74-8afd-68416cc7143a, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 19:02:05 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Volume volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5 (019cc3cc-419f-4aed-bbe3-6c2db36523f5): created successfully Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49849611-ce3d-4685-895d-99cbd22cdeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Flow 'volume_create_manager' (b5672248-e9ed-4cce-b8be-f95d189bd9d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fd54cb89-e477-4bca-8108-bb7c93feb3be tempest-CinderUnicodeTest-902166018 None] Created volume successfully. Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d584dd-3167-4f88-957e-cdac11e47c3d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:05 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 Jul 11 19:02:05 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:05 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8371fdb6-661b-447e-9893-bb8c3f196e73" returned: 0 in 0.810s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-quobyte-8371fdb6-661b-447e-9893-bb8c3f196e73" released by "delete_volume" :: held 1.989s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Created reservations ['c422c3de-548e-4ee8-bb2e-f9d33359f4fd', '03139568-944c-4fdf-850b-6d840d70e3d0', 'cfdfc909-75d4-4b36-b31b-f334011c009e', '01cfb28c-4693-4bc4-a665-2b5c4e613f37'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:05 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "cinder-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:05 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "cinder-quobyte-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-quobyte-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21" acquired by "delete_volume" :: waited 0.020s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a5b191-3e9a-45f1-b4c7-b9fe17a71d55]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:06 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 Jul 11 19:02:06 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:06 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4" returned: 0 in 0.985s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:02:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 19:02:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 19:02:06 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3f228b-5889-416a-b15d-4e647b202493]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:06 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a Jul 11 19:02:06 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:06 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.926s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:06 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:06 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Deleted volume successfully. Jul 11 19:02:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2038d920-eee0-44a2-9ff5-37b40e2f6f0b tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-8371fdb6-661b-447e-9893-bb8c3f196e73-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:07 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21" returned: 0 in 1.335s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:02:07 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21 Jul 11 19:02:07 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Flow 'volume_create_manager' (3546b750-9370-471b-b157-ccc7085b4a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ba344d-5057-4fc8-93f7-b80a29a6a963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ba344d-5057-4fc8-93f7-b80a29a6a963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-334037127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5730091-4e89-465d-b8bd-ff8c9fb9aca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bd6ae6dab4bfd80ff8df25d5d94b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:07Z,use_quota=True,user_id='c7fc2a179bed4970a62f9027a8ad9985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb5b2ad-720c-4ca1-97f8-931456a62cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb5b2ad-720c-4ca1-97f8-931456a62cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82cb9511-a694-42be-b455-c7969120f939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82cb9511-a694-42be-b455-c7969120f939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5730091-4e89-465d-b8bd-ff8c9fb9aca1', 'volume_name': 'volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4745c71a-9d75-4958-9197-406f20d765a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4745c71a-9d75-4958-9197-406f20d765a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed0f95c-acab-44c4-95ea-e0b3443ae46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:07 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Volume f5730091-4e89-465d-b8bd-ff8c9fb9aca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1', 'volume_size': 1} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:07 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" returned: 0 in 1.184s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 19:02:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:07 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a Jul 11 19:02:07 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:08 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21" returned: 0 in 0.936s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-quobyte-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21" released by "delete_volume" :: held 2.335s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:08 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Created reservations ['c982ce0b-f35a-412b-bd4f-4ec05d519287', '04f3ed8c-618b-449b-9611-35c9376dcda3', 'c6165b73-1efb-494d-94de-ea2f4fcd2a2f', '16b7cdba-dec6-427b-a527-eeba1ab9d477'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:08 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:08 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:08 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "cinder-a6c4a196-86bd-4414-adb2-7e012df55f2b-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-a6c4a196-86bd-4414-adb2-7e012df55f2b-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "cinder-quobyte-a6c4a196-86bd-4414-adb2-7e012df55f2b" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-quobyte-a6c4a196-86bd-4414-adb2-7e012df55f2b" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:09 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd49a09-4f5b-41f3-8ed8-f97a1a3c242d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:09 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b Jul 11 19:02:09 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:10 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 2.150s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:10 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:10 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Deleted volume successfully. Jul 11 19:02:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7f6cabbb-d5d3-4a54-b169-d78afb016137 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-d4712e22-3ba3-4b8b-84e9-b95e6ded0e21-delete_volume" released by "delete_volume" :: held 4.751s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:10 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b" returned: 0 in 1.209s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:10 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b Jul 11 19:02:10 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:12 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-a6c4a196-86bd-4414-adb2-7e012df55f2b" returned: 0 in 1.915s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-quobyte-a6c4a196-86bd-4414-adb2-7e012df55f2b" released by "delete_volume" :: held 3.253s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:12 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Created reservations ['37a4f092-ff73-4038-8396-0dcb9dd37a8d', '222b9f63-8573-41f2-a068-d503575d21cd', '920bfdac-34ce-49d9-96bb-ceb4f2a300bd', 'e0bea45b-5dad-42da-ac3e-9c29c8a24636'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:13 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:13 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:13 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a" returned: 0 in 6.105s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ae77d-a611-4688-aaf2-fdee1ee8c9fa]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:13 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a Jul 11 19:02:13 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:13 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.846s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:13 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Deleted volume successfully. Jul 11 19:02:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b35dd9f-7ff6-4218-9e1c-392b8d6e77d7 tempest-CreateVolumesFromImageTest-110140363 None] Lock "cinder-a6c4a196-86bd-4414-adb2-7e012df55f2b-delete_volume" released by "delete_volume" :: held 4.592s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:14 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" returned: 0 in 1.063s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:14 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:02:14 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Converted 1024.00 MB image at 167.68 MB/s Jul 11 19:02:14 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a is being set with open permissions: ugo+rw Jul 11 19:02:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:14 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a Jul 11 19:02:14 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:15 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a" returned: 0 in 0.727s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-dc048c1e-dd22-4e74-8afd-68416cc7143a" released by "_copy_volume_from_snapshot" :: held 10.199s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-af64dfaf-8568-4281-92af-563da9ce13a4-dc048c1e-dd22-4e74-8afd-68416cc7143a" released by "_create_volume_from_snapshot" :: held 10.254s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.277s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.167s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-334037127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5730091-4e89-465d-b8bd-ff8c9fb9aca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9bd6ae6dab4bfd80ff8df25d5d94b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:07Z,use_quota=True,user_id='c7fc2a179bed4970a62f9027a8ad9985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Creating volume f5730091-4e89-465d-b8bd-ff8c9fb9aca1 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:02:15 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:15 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 1073741824 Jul 11 19:02:15 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485f9df3-726e-42e4-b217-8ce41a227a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc048c1e-dd22-4e74-8afd-68416cc7143a', 'volume_size': 1, 'snapshot_id': 'af64dfaf-8568-4281-92af-563da9ce13a4'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80d52e1-c0c6-4b94-8f9b-c263ee498a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Volume volume-dc048c1e-dd22-4e74-8afd-68416cc7143a (dc048c1e-dd22-4e74-8afd-68416cc7143a): created successfully Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80d52e1-c0c6-4b94-8f9b-c263ee498a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Flow 'volume_create_manager' (1f1cdae8-3088-4468-828b-5d0957fc5672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-971c2c21-7310-4f1c-9d0d-220bf755a781 tempest-VolumeDependencyTests-1331781260 None] Created volume successfully. Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "cinder-af64dfaf-8568-4281-92af-563da9ce13a4-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-af64dfaf-8568-4281-92af-563da9ce13a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "cinder-quobyte-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "cinder-quobyte-af64dfaf-8568-4281-92af-563da9ce13a4" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-af64dfaf-8568-4281-92af-563da9ce13a4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Deleting offline snapshot af64dfaf-8568-4281-92af-563da9ce13a4 of volume 81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] snapshot_file for this snap is: volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba8537d-74b3-41f3-8716-af113fa33057]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:16 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 Jul 11 19:02:16 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:16 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 1073741824" returned: 0 in 1.279s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:16 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 Jul 11 19:02:16 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:17 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4" returned: 0 in 1.276s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee2fccf-7829-49a9-a4b1-2ae053356d2f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:17 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" returned: 0 in 0.950s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] <== create_volume: return (2313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed0f95c-acab-44c4-95ea-e0b3443ae46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308289d0-28f2-4141-9479-26d5b4478a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:17 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a Jul 11 19:02:17 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:17 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Volume volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 (f5730091-4e89-465d-b8bd-ff8c9fb9aca1): created successfully Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308289d0-28f2-4141-9479-26d5b4478a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Flow 'volume_create_manager' (3546b750-9370-471b-b157-ccc7085b4a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:17 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7b06f5b5-ca2f-4ce5-a23b-489f69d9db65 tempest-CinderUnicodeTest-902166018 None] Created volume successfully. Jul 11 19:02:18 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" returned: 0 in 1.076s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:18 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 Jul 11 19:02:18 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Creating offline snapshot c4abc81a-7b84-4591-b232-60e204f13b5f of volume f5730091-4e89-465d-b8bd-ff8c9fb9aca1 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:02:19 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ee741c-1c9b-44c9-aa96-1534a6df5285]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:19 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 Jul 11 19:02:19 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:19 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4" returned: 0 in 1.187s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:20 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4 Jul 11 19:02:20 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:20 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" returned: 0 in 1.108s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:20 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f 1G Jul 11 19:02:20 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Flow 'volume_create_manager' (a03eda49-555c-49b3-915c-5d221b48f355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7b5189-6e58-4cff-8f71-fa44ef4f2330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7b5189-6e58-4cff-8f71-fa44ef4f2330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7f0a4e-2741-4586-8d04-e1cdf8dea10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809d08d344804c86b2bcbd1d743545be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:20Z,use_quota=True,user_id='d9fe1a28f1054b378e97a4eb04b881cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e04eb0-2132-4adf-94cc-170ef085a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e04eb0-2132-4adf-94cc-170ef085a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e9a3d0-e171-4be4-9144-17c6416ea0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG cinder.image.glance [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Creating Keystone auth plugin from conf {{(pid=87411) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 19:02:20 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a.af64dfaf-8568-4281-92af-563da9ce13a4" returned: 0 in 0.909s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-af64dfaf-8568-4281-92af-563da9ce13a4" released by "_delete_snapshot" :: held 4.601s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" released by "delete_snapshot" :: held 4.637s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Created reservations ['c0651da8-5e06-4701-bb9a-e6b98db17e31', '00c1035b-205d-4a1c-b251-b6ff0551188a', '165ac3f7-6c12-49b7-9bec-909077f6808e', '6e5f491e-23e8-4da9-9b9c-3ed2b7319266'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e9a3d0-e171-4be4-9144-17c6416ea0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'df7f0a4e-2741-4586-8d04-e1cdf8dea10b', 'volume_name': 'volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b', 'volume_size': 1, 'image_id': 'e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673e5a39209f9ab5807e37817d2dfe9a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '809d08d344804c86b2bcbd1d743545be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0c7d3eba9388b76cfc1ef933662de4b009e37af835388c36158875042deb730497df5e9c492a14c887de923bd1f414b2c45a3bbfd8cbdcae48fea8414db12c8', 'id': 'e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'created_at': datetime.datetime(2026, 7, 11, 17, 2, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 2, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e44f81fb-378e-4d9e-810c-bcccd3d6b01f/file', 'properties': {}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5c7f60-2973-4a89-bfad-d0cda7bc7dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5c7f60-2973-4a89-bfad-d0cda7bc7dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca864adc-5f66-4399-85e0-40ef8b9b52cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:21 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Volume df7f0a4e-2741-4586-8d04-e1cdf8dea10b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b', 'volume_size': 1, 'image_id': 'e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673e5a39209f9ab5807e37817d2dfe9a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '809d08d344804c86b2bcbd1d743545be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0c7d3eba9388b76cfc1ef933662de4b009e37af835388c36158875042deb730497df5e9c492a14c887de923bd1f414b2c45a3bbfd8cbdcae48fea8414db12c8', 'id': 'e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'created_at': datetime.datetime(2026, 7, 11, 17, 2, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 2, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e44f81fb-378e-4d9e-810c-bcccd3d6b01f/file', 'properties': {}}, 'image_service': } Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Trying to clone df7f0a4e-2741-4586-8d04-e1cdf8dea10b from image e44f81fb-378e-4d9e-810c-bcccd3d6b01f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'metadata': {}}]). {{(pid=87411) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 19:02:21 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Delete snapshot completed successfully. Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2efffaec-11c4-4aae-afae-a5860802c44b tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-af64dfaf-8568-4281-92af-563da9ce13a4-delete_snapshot" released by "delete_snapshot" :: held 4.930s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:21 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 11 19:02:21 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Image download 0.00 MB at 0.00 MB/s Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f 1G" returned: 0 in 1.027s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:21 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f Jul 11 19:02:21 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b9a690-6d87-41b9-a9c9-bcfef0d0f575]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:21 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD Jul 11 19:02:21 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "cinder-81df8345-d71a-4ea6-a0af-e9bb3d5c684a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-81df8345-d71a-4ea6-a0af-e9bb3d5c684a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "cinder-quobyte-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6668a0-3d9e-49c8-83dc-219ba01412cb]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:21 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a Jul 11 19:02:21 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:22 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f" returned: 0 in 0.838s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:22 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f is being set with open permissions: ugo+rw Jul 11 19:02:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:22 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f Jul 11 19:02:22 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:22 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:22 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD Jul 11 19:02:22 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:22 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" returned: 0 in 1.038s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:22 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a Jul 11 19:02:22 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:22 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f" returned: 0 in 0.845s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:23 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.info Jul 11 19:02:23 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:23 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD" returned: 1 in 0.990s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Temporary image e44f81fb-378e-4d9e-810c-bcccd3d6b01f is fetched for user d9fe1a28f1054b378e97a4eb04b881cd. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac29962-2638-4b67-a142-d0ad655f0024]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:23 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD Jul 11 19:02:23 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:23 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" returned: 0 in 0.794s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-81df8345-d71a-4ea6-a0af-e9bb3d5c684a" released by "delete_volume" :: held 1.916s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Created reservations ['74624e60-ab2e-4cc4-ad7c-ca8a1f4085dc', 'ffefc5a4-5b30-488f-a491-25d96d66d6f9', '97d5d952-440e-4121-969f-1204dd8501e3', 'dea7697a-6865-4017-a446-b99825a68802'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:23 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.info" returned: 0 in 0.823s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:23 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.info is being set with open permissions: ugo+rw Jul 11 19:02:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:23 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:23 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:23 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.info Jul 11 19:02:23 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "cinder-dc048c1e-dd22-4e74-8afd-68416cc7143a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-dc048c1e-dd22-4e74-8afd-68416cc7143a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "cinder-quobyte-dc048c1e-dd22-4e74-8afd-68416cc7143a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-dc048c1e-dd22-4e74-8afd-68416cc7143a" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:24 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD" returned: 0 in 0.934s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e54b0c-0c30-423e-909e-ee00412abf4b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:24 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD Jul 11 19:02:24 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:24 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a Jul 11 19:02:24 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:24 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.871s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Deleted volume successfully. Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-435d0acd-0214-4a77-a7e6-1ddb8e06496f tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-81df8345-d71a-4ea6-a0af-e9bb3d5c684a-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:24 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.info" returned: 0 in 1.022s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.781s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-39757ea6-1d70-43d3-a0e0-828edfdccb86 tempest-CinderUnicodeTest-902166018 None] Create snapshot completed successfully Jul 11 19:02:25 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD" returned: 1 in 0.925s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7f0a4e-2741-4586-8d04-e1cdf8dea10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809d08d344804c86b2bcbd1d743545be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:20Z,use_quota=True,user_id='d9fe1a28f1054b378e97a4eb04b881cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Creating volume df7f0a4e-2741-4586-8d04-e1cdf8dea10b {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:02:25 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:25 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b 1073741824 Jul 11 19:02:25 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:25 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a" returned: 0 in 1.063s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:25 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a Jul 11 19:02:25 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Acquiring lock "cinder-c4abc81a-7b84-4591-b232-60e204f13b5f-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Lock "cinder-c4abc81a-7b84-4591-b232-60e204f13b5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Acquiring lock "cinder-quobyte-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Lock "cinder-quobyte-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Acquiring lock "cinder-quobyte-c4abc81a-7b84-4591-b232-60e204f13b5f" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Lock "cinder-quobyte-c4abc81a-7b84-4591-b232-60e204f13b5f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Deleting offline snapshot c4abc81a-7b84-4591-b232-60e204f13b5f of volume f5730091-4e89-465d-b8bd-ff8c9fb9aca1 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] snapshot_file for this snap is: volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8721ab31-df48-45a3-a4ab-399c020dba6e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:25 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f Jul 11 19:02:25 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:26 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-dc048c1e-dd22-4e74-8afd-68416cc7143a" returned: 0 in 0.754s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-quobyte-dc048c1e-dd22-4e74-8afd-68416cc7143a" released by "delete_volume" :: held 1.902s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:26 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b 1073741824" returned: 0 in 0.953s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Created reservations ['21fd928a-a8f2-4032-a409-b50a38657c5c', '960fdb0c-8d7f-436f-8a54-0bfac6f76a6a', '35f15f20-1bc4-47ce-8f8a-8a63c7c8eda5', 'aecce9a7-8754-46de-a704-4e94e6a11f26'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:26 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b Jul 11 19:02:26 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:26 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:26 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:26 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f" returned: 0 in 1.302s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0db2498-8c30-4606-b7eb-59b25b6fd776]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:27 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 Jul 11 19:02:27 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:27 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b" returned: 0 in 1.065s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:02:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:27 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Attempting download of e44f81fb-378e-4d9e-810c-bcccd3d6b01f ((None, [{'url': 'file:///opt/stack/data/glance/images/e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'metadata': {}}])) to volume df7f0a4e-2741-4586-8d04-e1cdf8dea10b. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 19:02:27 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.975s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:27 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:27 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d18d287-6a6d-4f54-a190-a5ed6b6cdc76]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_5n3jx5pt {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:27 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Deleted volume successfully. Jul 11 19:02:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-738950ce-843a-42e3-8cb9-6972af8c523d tempest-VolumeDependencyTests-1331781260 None] Lock "cinder-dc048c1e-dd22-4e74-8afd-68416cc7143a-delete_volume" released by "delete_volume" :: held 3.345s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:27 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_5n3jx5pt Jul 11 19:02:27 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:28 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" returned: 0 in 1.059s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:28 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f Jul 11 19:02:28 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:28 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_5n3jx5pt" returned: 0 in 0.973s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_5n3jx5pt {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:28 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_5n3jx5pt Jul 11 19:02:28 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:29 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f" returned: 0 in 1.071s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:29 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f Jul 11 19:02:29 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:29 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_5n3jx5pt" returned: 1 in 1.044s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_5n3jx5pt' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:02:29 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8136d9-3af3-44a7-a248-fbbf57c59ac9]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:29 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD Jul 11 19:02:29 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:30 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1.c4abc81a-7b84-4591-b232-60e204f13b5f" returned: 0 in 0.909s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Lock "cinder-quobyte-c4abc81a-7b84-4591-b232-60e204f13b5f" released by "_delete_snapshot" :: held 4.489s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Lock "cinder-quobyte-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" released by "delete_snapshot" :: held 4.522s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:30 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Created reservations ['da17a863-8b7e-4722-8fa8-afe28af2d681', 'db8394a8-237c-4dfd-b728-e2a04a33f004', '4ba9ae20-50c0-4fdf-8ab9-818e530ae95e', '0650ba7b-7f27-4c0d-92e3-c9c6e7a855bd'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:30 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Delete snapshot completed successfully. Jul 11 19:02:30 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-fad745bc-6e29-42b2-8033-29260dd7c3fb tempest-CinderUnicodeTest-902166018 None] Lock "cinder-c4abc81a-7b84-4591-b232-60e204f13b5f-delete_snapshot" released by "delete_snapshot" :: held 4.754s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:30 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD" returned: 0 in 0.912s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:30 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD Jul 11 19:02:30 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Acquiring lock "cinder-f5730091-4e89-465d-b8bd-ff8c9fb9aca1-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Lock "cinder-f5730091-4e89-465d-b8bd-ff8c9fb9aca1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Acquiring lock "cinder-quobyte-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Lock "cinder-quobyte-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" acquired by "delete_volume" :: waited 0.029s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1295156-f7bd-46f9-b162-bd43e0563325]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:31 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD" returned: 1 in 0.980s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] e44f81fb-378e-4d9e-810c-bcccd3d6b01f was raw, converting to raw {{(pid=87411) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:31 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b Jul 11 19:02:31 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:02:31 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 Jul 11 19:02:31 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (898c650d-a160-44e6-bf66-fe8aeab9a919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a174b3b7-c4e7-48db-9eaf-db9ce7b69f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a174b3b7-c4e7-48db-9eaf-db9ce7b69f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379150262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5db94e-d279-4a5a-9e23-8f2c3a8a1209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:31Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77c72d7-f1d5-4860-8cc0-0882a05d2c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77c72d7-f1d5-4860-8cc0-0882a05d2c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b210ccb-8a99-4a4d-b866-d6494bf13b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b210ccb-8a99-4a4d-b866-d6494bf13b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5db94e-d279-4a5a-9e23-8f2c3a8a1209', 'volume_name': 'volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8fbf47-012b-4f30-85ae-036908e9f6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8fbf47-012b-4f30-85ae-036908e9f6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ce7989-6e46-4fea-b5ec-f8b43296a4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:31 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Volume ee5db94e-d279-4a5a-9e23-8f2c3a8a1209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209', 'volume_size': 1} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379150262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5db94e-d279-4a5a-9e23-8f2c3a8a1209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:31Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Creating volume ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:02:31 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:02:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:31 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 1073741824 Jul 11 19:02:31 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:32 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b" returned: 0 in 0.863s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:32 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e44f81fb-378e-4d9e-810c-bcccd3d6b01f_ukdsigvqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:02:32 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 19:02:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:32 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b 1G Jul 11 19:02:32 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:32 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" returned: 0 in 1.064s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:32 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1 Jul 11 19:02:32 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:32 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 1073741824" returned: 0 in 1.058s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:32 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 Jul 11 19:02:32 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:33 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b 1G" returned: 0 in 0.868s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:33 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" returned: 0 in 0.808s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bb2c86-bc31-4c62-8591-9fd276acf5ab]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Lock "cinder-quobyte-f5730091-4e89-465d-b8bd-ff8c9fb9aca1" released by "delete_volume" :: held 1.979s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Created reservations ['67a3600c-7212-4248-9756-7e837ac50ba8', '53a0a0e6-346f-421a-930f-575872ac39ba', '028739fe-4a40-4b86-b482-d5b93df62515', '4aae0718-5ca0-4700-a403-99a878e6efbd'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:33 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b Jul 11 19:02:33 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:33 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:33 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Acquiring lock "cinder-019cc3cc-419f-4aed-bbe3-6c2db36523f5-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Lock "cinder-019cc3cc-419f-4aed-bbe3-6c2db36523f5-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:33 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Acquiring lock "cinder-quobyte-019cc3cc-419f-4aed-bbe3-6c2db36523f5" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" returned: 0 in 1.082s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Lock "cinder-quobyte-019cc3cc-419f-4aed-bbe3-6c2db36523f5" acquired by "delete_volume" :: waited 0.033s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ce7989-6e46-4fea-b5ec-f8b43296a4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622b621c-019d-435f-82c8-cc38fa1dcb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8901ccf-2cc7-4c41-8bd7-c121a24d7479]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:33 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Volume volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 (ee5db94e-d279-4a5a-9e23-8f2c3a8a1209): created successfully Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622b621c-019d-435f-82c8-cc38fa1dcb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:33 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (898c650d-a160-44e6-bf66-fe8aeab9a919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:33 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-abf0f620-c8c1-43b5-8508-b67ba2930231 tempest-ProjectMemberTests-884888780 None] Created volume successfully. Jul 11 19:02:33 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5 Jul 11 19:02:33 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:34 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b" returned: 0 in 1.069s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:34 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.913s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:34 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b Jul 11 19:02:34 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:34 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Deleted volume successfully. Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3796a21f-fb78-47fc-b774-1d9af398290b tempest-CinderUnicodeTest-902166018 None] Lock "cinder-f5730091-4e89-465d-b8bd-ff8c9fb9aca1-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:34 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5" returned: 0 in 1.099s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:34 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5 Jul 11 19:02:34 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Flow 'volume_create_manager' (eee5b790-559d-4a15-9faf-d163e92fd577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c55c1d-6d24-4416-84a9-494c55c80dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c55c1d-6d24-4416-84a9-494c55c80dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-30744268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07047465-1244-4fc2-a1df-7c245943cd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775cbb3b98234b3f9910cdb563cbecbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:35Z,use_quota=True,user_id='7c04e57c2a7e41539c0418a791243a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a09e9c4-d43b-4ea3-a1e4-b0f4db8f8e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a09e9c4-d43b-4ea3-a1e4-b0f4db8f8e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f334ba3b-b934-409f-aef3-019318e31d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f334ba3b-b934-409f-aef3-019318e31d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07047465-1244-4fc2-a1df-7c245943cd38', 'volume_name': 'volume-07047465-1244-4fc2-a1df-7c245943cd38', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cc4591-3220-44ee-803d-45fc30f38f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cc4591-3220-44ee-803d-45fc30f38f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015e9907-48ae-44b1-acfc-dfa4b471e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:34 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Volume 07047465-1244-4fc2-a1df-7c245943cd38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07047465-1244-4fc2-a1df-7c245943cd38', 'volume_size': 1} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-30744268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07047465-1244-4fc2-a1df-7c245943cd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775cbb3b98234b3f9910cdb563cbecbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:35Z,use_quota=True,user_id='7c04e57c2a7e41539c0418a791243a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Creating volume 07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:02:35 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:35 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 1073741824 Jul 11 19:02:35 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:35 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b" returned: 1 in 0.903s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Downloaded image e44f81fb-378e-4d9e-810c-bcccd3d6b01f ((None, [{'url': 'file:///opt/stack/data/glance/images/e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'metadata': {}}])) to volume df7f0a4e-2741-4586-8d04-e1cdf8dea10b successfully. {{(pid=87411) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Temporary image e44f81fb-378e-4d9e-810c-bcccd3d6b01f for user d9fe1a28f1054b378e97a4eb04b881cd is deleted. {{(pid=87411) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.volume_utils [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Marking volume df7f0a4e-2741-4586-8d04-e1cdf8dea10b as bootable. {{(pid=87411) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Copying metadata from image e44f81fb-378e-4d9e-810c-bcccd3d6b01f to df7f0a4e-2741-4586-8d04-e1cdf8dea10b. {{(pid=87411) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Creating volume glance metadata for volume df7f0a4e-2741-4586-8d04-e1cdf8dea10b backed by image e44f81fb-378e-4d9e-810c-bcccd3d6b01f with: {'image_id': 'e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '673e5a39209f9ab5807e37817d2dfe9a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87411) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca864adc-5f66-4399-85e0-40ef8b9b52cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b', 'volume_size': 1, 'image_id': 'e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '673e5a39209f9ab5807e37817d2dfe9a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '809d08d344804c86b2bcbd1d743545be', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0c7d3eba9388b76cfc1ef933662de4b009e37af835388c36158875042deb730497df5e9c492a14c887de923bd1f414b2c45a3bbfd8cbdcae48fea8414db12c8', 'id': 'e44f81fb-378e-4d9e-810c-bcccd3d6b01f', 'created_at': datetime.datetime(2026, 7, 11, 17, 2, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 17, 2, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e44f81fb-378e-4d9e-810c-bcccd3d6b01f/file', 'properties': {}}, 'image_service': }' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b367e291-16df-40f3-a82e-54135ebf5a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:35 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Volume volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b (df7f0a4e-2741-4586-8d04-e1cdf8dea10b): created successfully Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b367e291-16df-40f3-a82e-54135ebf5a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Flow 'volume_create_manager' (a03eda49-555c-49b3-915c-5d221b48f355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f363e3d3-9cb6-49fc-bb16-d6e5bcbf7ce9 tempest-VolumeImageDependencyTests-501024549 None] Created volume successfully. Jul 11 19:02:35 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-019cc3cc-419f-4aed-bbe3-6c2db36523f5" returned: 0 in 0.719s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Lock "cinder-quobyte-019cc3cc-419f-4aed-bbe3-6c2db36523f5" released by "delete_volume" :: held 1.877s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Created reservations ['6d4cc75e-f957-4089-8149-c528187c9cea', 'f4e053ad-3038-4230-97ea-b5847dd95ed4', '3ba13e2e-b457-433d-aa76-85d03a01be93', 'd3da5948-e1be-4978-ba06-8609522be964'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:35 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:35 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Acquiring lock "cinder-df7f0a4e-2741-4586-8d04-e1cdf8dea10b-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Lock "cinder-df7f0a4e-2741-4586-8d04-e1cdf8dea10b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:35 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 1073741824" returned: 0 in 0.946s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Acquiring lock "cinder-quobyte-df7f0a4e-2741-4586-8d04-e1cdf8dea10b" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Lock "cinder-quobyte-df7f0a4e-2741-4586-8d04-e1cdf8dea10b" acquired by "delete_volume" :: waited 0.035s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:36 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 Jul 11 19:02:36 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6f6a15-5b3e-46e7-8c6c-a8ad6734e416]: (4, 'raw') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:36 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b Jul 11 19:02:36 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:36 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.784s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Deleted volume successfully. Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-495c8de4-1f40-411b-a6dc-bdb164efacd3 tempest-CinderUnicodeTest-902166018 None] Lock "cinder-019cc3cc-419f-4aed-bbe3-6c2db36523f5-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:36 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38" returned: 0 in 0.776s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.720s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015e9907-48ae-44b1-acfc-dfa4b471e842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07047465-1244-4fc2-a1df-7c245943cd38', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4829ddc5-a82e-4d9d-b9ce-9b416f5133c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Creating offline snapshot c613c545-c88b-4bb4-8f47-87144608016c of volume ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:02:36 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Volume volume-07047465-1244-4fc2-a1df-7c245943cd38 (07047465-1244-4fc2-a1df-7c245943cd38): created successfully Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4829ddc5-a82e-4d9d-b9ce-9b416f5133c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Flow 'volume_create_manager' (eee5b790-559d-4a15-9faf-d163e92fd577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[deecbdfe-e8cb-4599-ab1d-5e8e9e99ff3a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:36 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-bef3fb0f-d580-4c68-958c-17612e221f76 tempest-SnapshotDependencyTests-1538673553 None] Created volume successfully. Jul 11 19:02:37 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 Jul 11 19:02:37 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:37 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b" returned: 0 in 0.897s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:37 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b Jul 11 19:02:37 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:37 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" returned: 0 in 0.944s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:37 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c 1G Jul 11 19:02:37 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:37 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b" returned: 1 in 0.898s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b' failed. Not Retrying. {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 19:02:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:37 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b Jul 11 19:02:37 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:38 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-df7f0a4e-2741-4586-8d04-e1cdf8dea10b" returned: 0 in 0.707s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Lock "cinder-quobyte-df7f0a4e-2741-4586-8d04-e1cdf8dea10b" released by "delete_volume" :: held 2.616s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:38 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c 1G" returned: 0 in 0.879s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:38 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c Jul 11 19:02:38 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Created reservations ['b523c680-2738-4b35-b6e5-b35334289a5e', '126828a0-46c4-49b6-999f-663045327d63', 'ba1c126c-7f7e-4974-a204-d7f9ad56da22', 'd8000682-2732-4e12-b067-fcd510a2e2e5'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:38 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:38 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:39 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c" returned: 0 in 0.780s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:39 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c is being set with open permissions: ugo+rw Jul 11 19:02:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:39 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c Jul 11 19:02:39 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:39 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.731s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:39 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:39 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Deleted volume successfully. Jul 11 19:02:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-199cc216-881f-4a48-b1c2-876396ccb4b5 tempest-VolumeImageDependencyTests-501024549 None] Lock "cinder-df7f0a4e-2741-4586-8d04-e1cdf8dea10b-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:39 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ba6c5eb6-b30a-4780-95d2-2691986af6ce tempest-ProjectAdminTests-1879857102 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87411) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 19:02:40 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c" returned: 0 in 0.675s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:40 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.info Jul 11 19:02:40 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:40 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.info" returned: 0 in 0.713s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:40 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.info is being set with open permissions: ugo+rw Jul 11 19:02:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:40 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.info Jul 11 19:02:40 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:41 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.info" returned: 0 in 0.744s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.874s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.311s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Creating offline snapshot a37fae8f-812a-43e4-bf7b-0fdaac10b229 of volume 07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:02:41 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ad113c77-a67b-469c-91fc-2b9072dd65a3 tempest-ProjectMemberTests-884888780 None] Create snapshot completed successfully Jul 11 19:02:41 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[510bed5e-8b54-4300-b0b8-79e0d38d1f3d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:41 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 Jul 11 19:02:41 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-c613c545-c88b-4bb4-8f47-87144608016c-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Lock "cinder-c613c545-c88b-4bb4-8f47-87144608016c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-c613c545-c88b-4bb4-8f47-87144608016c" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-c613c545-c88b-4bb4-8f47-87144608016c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Deleting offline snapshot c613c545-c88b-4bb4-8f47-87144608016c of volume ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] snapshot_file for this snap is: volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ddd170-92de-4420-84fb-fe212ffca10e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:42 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38" returned: 0 in 0.983s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:42 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c Jul 11 19:02:42 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:42 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 1G Jul 11 19:02:42 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:43 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c" returned: 0 in 0.897s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:02:43 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[673ef621-0a84-44a3-b2a7-a91e4a132527]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:43 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 1G" returned: 0 in 0.924s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07047465-1244-4fc2-a1df-7c245943cd38 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:43 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 Jul 11 19:02:43 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:43 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07047465-1244-4fc2-a1df-7c245943cd38 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 Jul 11 19:02:43 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:44 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" returned: 0 in 0.845s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:44 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c Jul 11 19:02:44 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:44 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07047465-1244-4fc2-a1df-7c245943cd38 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229" returned: 0 in 0.834s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:44 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 is being set with open permissions: ugo+rw Jul 11 19:02:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:44 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 Jul 11 19:02:44 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:45 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c" returned: 0 in 0.807s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:45 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229" returned: 0 in 0.713s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:45 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c Jul 11 19:02:45 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:45 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.info Jul 11 19:02:45 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:46 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.info" returned: 0 in 0.779s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:46 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.info is being set with open permissions: ugo+rw Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:46 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209.c613c545-c88b-4bb4-8f47-87144608016c" returned: 0 in 0.858s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:46 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.info Jul 11 19:02:46 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-c613c545-c88b-4bb4-8f47-87144608016c" released by "_delete_snapshot" :: held 3.593s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" released by "delete_snapshot" :: held 3.630s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Created reservations ['2fde1c20-d5b5-4acc-932b-76d5f47499de', '012c13d3-52b5-466e-8914-7db7088fc70a', '05fd7be2-9386-405b-a701-761414179359', '6c701d55-581f-4443-aeca-2a3d7315d727'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:46 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Delete snapshot completed successfully. Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-62ed0d86-a754-4bd4-b3dd-01e7e462e1c1 tempest-ProjectMemberTests-884888780 None] Lock "cinder-c613c545-c88b-4bb4-8f47-87144608016c-delete_snapshot" released by "delete_snapshot" :: held 3.824s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:46 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.info" returned: 0 in 0.716s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.084s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:46 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7303ec4e-a5c8-4a2a-b898-68a53fbc8949 tempest-SnapshotDependencyTests-1538673553 None] Create snapshot completed successfully Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Lock "cinder-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d2b51-c5a6-4864-b842-b60213e77c7f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:47 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 Jul 11 19:02:47 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:47 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" returned: 0 in 0.883s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:47 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209 Jul 11 19:02:47 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:48 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" returned: 0 in 0.838s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209" released by "delete_volume" :: held 1.801s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Flow 'volume_create_manager' (d6d3c31a-9c26-4b8e-938a-632945b36234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72505a9-38ab-473b-ba7c-98eb11c31f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72505a9-38ab-473b-ba7c-98eb11c31f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e569f62a-8abe-4e85-9a55-53adcf1aae37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775cbb3b98234b3f9910cdb563cbecbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a37fae8f-812a-43e4-bf7b-0fdaac10b229,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:49Z,use_quota=True,user_id='7c04e57c2a7e41539c0418a791243a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84022fc0-9e5e-4562-a94e-541b95dae22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84022fc0-9e5e-4562-a94e-541b95dae22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1c5242-204a-43d3-92bc-203dd9c2a9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1c5242-204a-43d3-92bc-203dd9c2a9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e569f62a-8abe-4e85-9a55-53adcf1aae37', 'volume_name': 'volume-e569f62a-8abe-4e85-9a55-53adcf1aae37', 'volume_size': 1, 'snapshot_id': 'a37fae8f-812a-43e4-bf7b-0fdaac10b229'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35b441b-472b-42cc-9d46-79a4b57ab420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35b441b-472b-42cc-9d46-79a4b57ab420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ba354b-49c8-4863-8b56-52f8efd5b849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:48 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Volume e569f62a-8abe-4e85-9a55-53adcf1aae37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e569f62a-8abe-4e85-9a55-53adcf1aae37', 'volume_size': 1, 'snapshot_id': 'a37fae8f-812a-43e4-bf7b-0fdaac10b229'} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "cinder-quobyte-a37fae8f-812a-43e4-bf7b-0fdaac10b229-e569f62a-8abe-4e85-9a55-53adcf1aae37" by "_create_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Created reservations ['cdafc5dd-f40d-4675-be4b-62d556fd9e9e', '770d3b0e-59dc-405e-bdd0-e1860b840a8b', 'fb332ecd-bf3d-48dc-9d2c-a9289ccfda20', '68f5b668-2b34-4a89-a4df-ebef16883fdd'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-a37fae8f-812a-43e4-bf7b-0fdaac10b229-e569f62a-8abe-4e85-9a55-53adcf1aae37" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Creating volume e569f62a-8abe-4e85-9a55-53adcf1aae37 from snapshot a37fae8f-812a-43e4-bf7b-0fdaac10b229 {{(pid=87411) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "cinder-quobyte-e569f62a-8abe-4e85-9a55-53adcf1aae37" by "_copy_volume_from_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-e569f62a-8abe-4e85-9a55-53adcf1aae37" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] snapshot: a37fae8f-812a-43e4-bf7b-0fdaac10b229, volume: e569f62a-8abe-4e85-9a55-53adcf1aae37, {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[876142e3-91e5-4411-8ae6-8c275cccbf7e]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:49 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:49 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:49 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:49 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:49 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 Jul 11 19:02:49 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:49 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.795s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:49 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:49 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Deleted volume successfully. Jul 11 19:02:49 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c59e0c77-91ef-4bb9-9c08-71f8d75c6c06 tempest-ProjectMemberTests-884888780 None] Lock "cinder-ee5db94e-d279-4a5a-9e23-8f2c3a8a1209-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (a408f7a6-b828-44e9-b1bc-3ea53054c16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d412741c-262e-4034-bc29-041694c19a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d412741c-262e-4034-bc29-041694c19a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2023067227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ef5933-3e97-45ee-b277-71ba79381e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:50Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa8db2e-04ab-4f68-9a5b-885f75a4a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa8db2e-04ab-4f68-9a5b-885f75a4a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:50 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a5c966-e0f9-419b-999f-567dabadccb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a5c966-e0f9-419b-999f-567dabadccb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ef5933-3e97-45ee-b277-71ba79381e5a', 'volume_name': 'volume-97ef5933-3e97-45ee-b277-71ba79381e5a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7735f2b6-415b-47f8-a580-94f3d071b4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7735f2b6-415b-47f8-a580-94f3d071b4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b23a79-0052-43ae-96b9-e7f9020ade4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Volume 97ef5933-3e97-45ee-b277-71ba79381e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ef5933-3e97-45ee-b277-71ba79381e5a', 'volume_size': 1} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229" returned: 0 in 1.160s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07047465-1244-4fc2-a1df-7c245943cd38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Creating direct copy from snapshot {{(pid=87411) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d20b55e-dc90-4066-8e93-8b630c467210]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:50 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 Jul 11 19:02:50 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Flow 'volume_create_manager' (daf8cf6f-f6c4-485b-af39-717ae44afe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1485547b-ced9-4f68-81cc-cff697f50de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1485547b-ced9-4f68-81cc-cff697f50de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1354576818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283dbc40-d0e1-4ed9-930b-e37bc4e6d744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ece735f45478ab903d0b318fbe287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:51Z,use_quota=True,user_id='8ea7e2a54257455db5d59455abee9aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec48de2-459a-4c4c-b095-4726fc1c88cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec48de2-459a-4c4c-b095-4726fc1c88cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d972a02f-c700-4b2f-b0a0-e16aa9eda3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d972a02f-c700-4b2f-b0a0-e16aa9eda3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '283dbc40-d0e1-4ed9-930b-e37bc4e6d744', 'volume_name': 'volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc902723-f1a8-41c5-a609-6b1cbd6386b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc902723-f1a8-41c5-a609-6b1cbd6386b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9ed887-24fb-4a83-b724-cf5ef001a727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Volume 283dbc40-d0e1-4ed9-930b-e37bc4e6d744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744', 'volume_size': 1} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:50 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38" returned: 0 in 0.813s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG cinder.utils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Path /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 not found in is_blk_device check {{(pid=87411) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 19:02:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:51 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 Jul 11 19:02:51 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:02:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:51 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:02:51 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:52 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.895s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:02:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:02:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:02:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:02:56 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37" returned: 0 in 5.118s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:56 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f87584-2ad9-43bc-b98c-4775e80f3e0a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:56 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 Jul 11 19:02:56 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:57 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38" returned: 0 in 0.937s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.image.image_utils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Image conversion details: src /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 {{(pid=87411) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 11 19:02:57 devstack cinder-volume[87411]: INFO cinder.image.image_utils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Converted 1024.00 MB image at 200.05 MB/s Jul 11 19:02:57 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 is being set with open permissions: ugo+rw Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:57 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 Jul 11 19:02:57 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:57 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37" returned: 0 in 0.645s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-e569f62a-8abe-4e85-9a55-53adcf1aae37" released by "_copy_volume_from_snapshot" :: held 8.789s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-a37fae8f-812a-43e4-bf7b-0fdaac10b229-e569f62a-8abe-4e85-9a55-53adcf1aae37" released by "_create_volume_from_snapshot" :: held 8.850s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.882s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.570s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2023067227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ef5933-3e97-45ee-b277-71ba79381e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:50Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Creating volume 97ef5933-3e97-45ee-b277-71ba79381e5a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:02:57 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:57 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a 1073741824 Jul 11 19:02:57 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ba354b-49c8-4863-8b56-52f8efd5b849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e569f62a-8abe-4e85-9a55-53adcf1aae37', 'volume_size': 1, 'snapshot_id': 'a37fae8f-812a-43e4-bf7b-0fdaac10b229'}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a400b42c-aacc-4b54-a2c6-34997dc9b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:57 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Volume volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 (e569f62a-8abe-4e85-9a55-53adcf1aae37): created successfully Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a400b42c-aacc-4b54-a2c6-34997dc9b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:57 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Flow 'volume_create_manager' (d6d3c31a-9c26-4b8e-938a-632945b36234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:57 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4b199d1d-6046-48a8-b3ac-75666df6dec2 tempest-SnapshotDependencyTests-1538673553 None] Created volume successfully. Jul 11 19:02:58 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a 1073741824" returned: 0 in 0.780s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:58 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a Jul 11 19:02:58 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "cinder-a37fae8f-812a-43e4-bf7b-0fdaac10b229-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-a37fae8f-812a-43e4-bf7b-0fdaac10b229-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "cinder-quobyte-07047465-1244-4fc2-a1df-7c245943cd38" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-07047465-1244-4fc2-a1df-7c245943cd38" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "cinder-quobyte-a37fae8f-812a-43e4-bf7b-0fdaac10b229" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-a37fae8f-812a-43e4-bf7b-0fdaac10b229" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Deleting offline snapshot a37fae8f-812a-43e4-bf7b-0fdaac10b229 of volume 07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] snapshot_file for this snap is: volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a86ba3-da91-4d1c-9ac7-be4f5c95495d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:58 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 Jul 11 19:02:58 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:59 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a" returned: 0 in 0.624s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.368s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1354576818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283dbc40-d0e1-4ed9-930b-e37bc4e6d744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ece735f45478ab903d0b318fbe287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:02:51Z,use_quota=True,user_id='8ea7e2a54257455db5d59455abee9aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Creating volume 283dbc40-d0e1-4ed9-930b-e37bc4e6d744 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:02:59 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b23a79-0052-43ae-96b9-e7f9020ade4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ef5933-3e97-45ee-b277-71ba79381e5a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:59 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744 1073741824 Jul 11 19:02:59 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1dac60-96be-4011-aa92-5ac6a19be3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:02:59 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Volume volume-97ef5933-3e97-45ee-b277-71ba79381e5a (97ef5933-3e97-45ee-b277-71ba79381e5a): created successfully Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1dac60-96be-4011-aa92-5ac6a19be3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (a408f7a6-b828-44e9-b1bc-3ea53054c16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:02:59 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e2dde5d9-465b-4da8-a06b-86d3a7c1faac tempest-ProjectMemberTests-884888780 None] Created volume successfully. Jul 11 19:02:59 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229" returned: 0 in 0.745s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07047465-1244-4fc2-a1df-7c245943cd38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce0f546-17cf-4de2-a916-a3ff0a80c6ee]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:02:59 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 Jul 11 19:02:59 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:02:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:00 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744 1073741824" returned: 0 in 0.856s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:00 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744 Jul 11 19:03:00 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:00 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38" returned: 0 in 0.809s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:00 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 Jul 11 19:03:00 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:00 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744" returned: 0 in 0.623s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.845s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9ed887-24fb-4a83-b724-cf5ef001a727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941704ce-97d6-4b16-be35-bb0aa2dde31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Creating offline snapshot 532c7a79-e042-43ec-94ac-852e4dd7670e of volume 97ef5933-3e97-45ee-b277-71ba79381e5a {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:03:00 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Volume volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744 (283dbc40-d0e1-4ed9-930b-e37bc4e6d744): created successfully Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941704ce-97d6-4b16-be35-bb0aa2dde31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Flow 'volume_create_manager' (daf8cf6f-f6c4-485b-af39-717ae44afe81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25dac0a-c1e5-49ca-ba4c-47ed8da2887a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:00 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-db308d11-bf5e-4d29-bae2-d7eb39c81dca tempest-ProjectReaderTests-828871946 None] Created volume successfully. Jul 11 19:03:00 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a Jul 11 19:03:00 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:01 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229" returned: 0 in 0.748s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:01 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229 Jul 11 19:03:01 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:01 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a" returned: 0 in 0.787s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:01 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e 1G Jul 11 19:03:01 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:01 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38.a37fae8f-812a-43e4-bf7b-0fdaac10b229" returned: 0 in 0.676s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=112,cinder:DELETE=15,cinder:INSERT=37,cinder:UPDATE=124 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-a37fae8f-812a-43e4-bf7b-0fdaac10b229" released by "_delete_snapshot" :: held 3.110s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-07047465-1244-4fc2-a1df-7c245943cd38" released by "delete_snapshot" :: held 3.136s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Created reservations ['b491573f-91be-44b1-8bf3-3b1f6a390eeb', 'fe1c67a8-18c4-4328-8afc-cc1dfb962856', '829508d7-70ed-4968-8023-baccd161738a', 'a7546693-84c4-477a-8816-b827bfa92ace'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:01 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Delete snapshot completed successfully. Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6c97df-b350-4bc4-8bf9-22feb640028f tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-a37fae8f-812a-43e4-bf7b-0fdaac10b229-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Acquiring lock "cinder-283dbc40-d0e1-4ed9-930b-e37bc4e6d744-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Lock "cinder-283dbc40-d0e1-4ed9-930b-e37bc4e6d744-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Acquiring lock "cinder-quobyte-283dbc40-d0e1-4ed9-930b-e37bc4e6d744" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Lock "cinder-quobyte-283dbc40-d0e1-4ed9-930b-e37bc4e6d744" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c05f18-277c-4e8d-971d-1f9cfeba2f3a]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:02 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744 Jul 11 19:03:02 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:02 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e 1G" returned: 0 in 0.842s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ef5933-3e97-45ee-b277-71ba79381e5a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:02 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ef5933-3e97-45ee-b277-71ba79381e5a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e Jul 11 19:03:02 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:02 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744" returned: 0 in 0.744s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:02 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744 Jul 11 19:03:02 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "cinder-07047465-1244-4fc2-a1df-7c245943cd38-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-07047465-1244-4fc2-a1df-7c245943cd38-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:02 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=101,cinder:INSERT=36,cinder:UPDATE=139,cinder:DELETE=9 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "cinder-quobyte-07047465-1244-4fc2-a1df-7c245943cd38" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-07047465-1244-4fc2-a1df-7c245943cd38" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67c6e7d-70a9-4999-ae43-d9f6cc8581ee]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:03 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ef5933-3e97-45ee-b277-71ba79381e5a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e" returned: 0 in 0.743s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:03 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e is being set with open permissions: ugo+rw Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:03 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e Jul 11 19:03:03 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:03 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 Jul 11 19:03:03 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:03 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-283dbc40-d0e1-4ed9-930b-e37bc4e6d744" returned: 0 in 0.729s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Lock "cinder-quobyte-283dbc40-d0e1-4ed9-930b-e37bc4e6d744" released by "delete_volume" :: held 1.516s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Created reservations ['17409080-4e20-4fb8-88bf-b1a34b0521b9', '31c1ab9d-13c8-4e94-aeff-65cf1b65c863', '4b7447c8-e49b-4b1b-b159-90d38d7d6045', '5d64e1d9-59b0-4a79-89c8-78f480f3e4fb'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:03 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:03 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:03 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e" returned: 0 in 0.661s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:03 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38" returned: 0 in 0.782s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:03 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.info Jul 11 19:03:03 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:03 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38 Jul 11 19:03:03 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:04 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.702s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:04 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Deleted volume successfully. Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-82022b42-8bb6-4386-aac8-0a9441137717 tempest-ProjectReaderTests-828871946 None] Lock "cinder-283dbc40-d0e1-4ed9-930b-e37bc4e6d744-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:04 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-07047465-1244-4fc2-a1df-7c245943cd38" returned: 0 in 0.732s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:04 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.info" returned: 0 in 0.767s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:04 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.info is being set with open permissions: ugo+rw Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-07047465-1244-4fc2-a1df-7c245943cd38" released by "delete_volume" :: held 1.609s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:04 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.info Jul 11 19:03:04 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Flow 'volume_create_manager' (bca12823-21b3-4835-974f-8354fd3f15a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9bcbb1-43b5-47d4-8109-25680eb8d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9bcbb1-43b5-47d4-8109-25680eb8d030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1154863922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c88d402-0e68-44fb-959e-4c93898a4d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ece735f45478ab903d0b318fbe287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:05Z,use_quota=True,user_id='8ea7e2a54257455db5d59455abee9aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db06d2d4-4f2a-44b3-9a62-6d0e0318d829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db06d2d4-4f2a-44b3-9a62-6d0e0318d829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53271bd-40bc-4130-bb89-a84db2131979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53271bd-40bc-4130-bb89-a84db2131979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c88d402-0e68-44fb-959e-4c93898a4d7f', 'volume_name': 'volume-4c88d402-0e68-44fb-959e-4c93898a4d7f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf123e9-5ff0-444a-a156-179fb21ec797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf123e9-5ff0-444a-a156-179fb21ec797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d54ea7-8c71-4cb4-8c12-7ada09d11ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:04 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Volume 4c88d402-0e68-44fb-959e-4c93898a4d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c88d402-0e68-44fb-959e-4c93898a4d7f', 'volume_size': 1} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Created reservations ['b81f2241-0f4f-4d6e-b084-87630454b3a7', '3185cf06-cea5-430f-8c26-ebdeb1e64da9', '39c62a7c-2f7a-4a44-b649-382f2c6bfbbd', 'b6d521d8-6371-485f-8198-c9d4f772af60'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:04 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:04 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "cinder-e569f62a-8abe-4e85-9a55-53adcf1aae37-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-e569f62a-8abe-4e85-9a55-53adcf1aae37-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "cinder-quobyte-e569f62a-8abe-4e85-9a55-53adcf1aae37" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-e569f62a-8abe-4e85-9a55-53adcf1aae37" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be98209-4dad-4c7b-8146-6b9628b1fd44]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:05 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.info" returned: 0 in 0.698s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.632s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1154863922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c88d402-0e68-44fb-959e-4c93898a4d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ece735f45478ab903d0b318fbe287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:05Z,use_quota=True,user_id='8ea7e2a54257455db5d59455abee9aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Creating volume 4c88d402-0e68-44fb-959e-4c93898a4d7f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:03:05 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:05 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f 1073741824 Jul 11 19:03:05 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 Jul 11 19:03:05 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:05 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d71726b7-7b7e-4457-8cdb-867a690e0acd tempest-ProjectMemberTests-884888780 None] Create snapshot completed successfully Jul 11 19:03:05 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.693s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Deleted volume successfully. Jul 11 19:03:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e4a959b9-4c14-40d8-9ec6-ec4f3b06d341 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-07047465-1244-4fc2-a1df-7c245943cd38-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:06 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37" returned: 0 in 0.810s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:06 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37 Jul 11 19:03:06 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-532c7a79-e042-43ec-94ac-852e4dd7670e-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Lock "cinder-532c7a79-e042-43ec-94ac-852e4dd7670e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-97ef5933-3e97-45ee-b277-71ba79381e5a" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-97ef5933-3e97-45ee-b277-71ba79381e5a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-532c7a79-e042-43ec-94ac-852e4dd7670e" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-532c7a79-e042-43ec-94ac-852e4dd7670e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Deleting offline snapshot 532c7a79-e042-43ec-94ac-852e4dd7670e of volume 97ef5933-3e97-45ee-b277-71ba79381e5a {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] snapshot_file for this snap is: volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ce600b-52af-4fa6-a55c-e8849dfc6114]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:06 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f 1073741824" returned: 0 in 0.946s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:06 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f Jul 11 19:03:06 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:06 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e Jul 11 19:03:06 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:06 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e569f62a-8abe-4e85-9a55-53adcf1aae37" returned: 0 in 0.757s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-quobyte-e569f62a-8abe-4e85-9a55-53adcf1aae37" released by "delete_volume" :: held 1.612s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Created reservations ['ba53c4ec-89ca-42a5-9ef2-df22219d2c01', '73cfb5ef-d37d-4dde-a934-13cfd91cdaf2', 'ff5d078c-7a2f-4349-85a8-dd079273b128', '679cb76b-ff80-4616-b805-776d360d768b'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:07 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:07 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:07 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f" returned: 0 in 0.682s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d54ea7-8c71-4cb4-8c12-7ada09d11ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c88d402-0e68-44fb-959e-4c93898a4d7f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7b4739-30d9-4872-a32c-9f7bc142e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:07 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Volume volume-4c88d402-0e68-44fb-959e-4c93898a4d7f (4c88d402-0e68-44fb-959e-4c93898a4d7f): created successfully Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7b4739-30d9-4872-a32c-9f7bc142e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Flow 'volume_create_manager' (bca12823-21b3-4835-974f-8354fd3f15a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-50e24c39-a5aa-4e43-a1d0-1727bb0fbd6e tempest-ProjectReaderTests-828871946 None] Created volume successfully. Jul 11 19:03:07 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e" returned: 0 in 0.863s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ef5933-3e97-45ee-b277-71ba79381e5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b7699f-0983-4e41-a7ae-9a4d7832aaad]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:07 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a Jul 11 19:03:07 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:07 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.716s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Deleted volume successfully. Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4b53062d-d043-4f59-a3fb-f458ea643326 tempest-SnapshotDependencyTests-1538673553 None] Lock "cinder-e569f62a-8abe-4e85-9a55-53adcf1aae37-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Acquiring lock "cinder-4c88d402-0e68-44fb-959e-4c93898a4d7f-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Lock "cinder-4c88d402-0e68-44fb-959e-4c93898a4d7f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:07 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a" returned: 0 in 0.829s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:08 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e Jul 11 19:03:08 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Acquiring lock "cinder-quobyte-4c88d402-0e68-44fb-959e-4c93898a4d7f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:08 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Lock "cinder-quobyte-4c88d402-0e68-44fb-959e-4c93898a4d7f" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:08 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98a5eab-bd5e-4b19-9f90-f0f920bc0573]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:08 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f Jul 11 19:03:08 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:08 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e" returned: 0 in 0.866s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:08 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e Jul 11 19:03:08 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:08 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f" returned: 0 in 0.860s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:08 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f Jul 11 19:03:08 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:09 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a.532c7a79-e042-43ec-94ac-852e4dd7670e" returned: 0 in 0.682s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-532c7a79-e042-43ec-94ac-852e4dd7670e" released by "_delete_snapshot" :: held 3.368s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-97ef5933-3e97-45ee-b277-71ba79381e5a" released by "delete_snapshot" :: held 3.407s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:09 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4c88d402-0e68-44fb-959e-4c93898a4d7f" returned: 0 in 0.742s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Created reservations ['737f64ce-0b5f-4b4c-b27c-4c36153afee5', 'dd597163-35d5-41d7-a0e5-bba08cb0ad15', 'bd102529-4e7e-4160-baab-5e90726643d3', '0d6fdc3a-b66e-4b0b-b357-bef565a9a8b1'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Lock "cinder-quobyte-4c88d402-0e68-44fb-959e-4c93898a4d7f" released by "delete_volume" :: held 1.649s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:09 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Delete snapshot completed successfully. Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-a4b27fd6-668e-4f9e-bc22-ba381233f56b tempest-ProjectMemberTests-884888780 None] Lock "cinder-532c7a79-e042-43ec-94ac-852e4dd7670e-delete_snapshot" released by "delete_snapshot" :: held 3.606s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Created reservations ['61068978-4979-4a83-9be6-d3a6d17e750a', 'e4f8dd88-e0d1-4569-a822-46e1b957bcfc', '114fb9fe-5234-432d-a429-1348bd56e2ad', 'c8745d27-1357-4855-a6f4-be060990d5a0'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:09 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:09 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-97ef5933-3e97-45ee-b277-71ba79381e5a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Lock "cinder-97ef5933-3e97-45ee-b277-71ba79381e5a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:10 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.850s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-97ef5933-3e97-45ee-b277-71ba79381e5a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:10 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Deleted volume successfully. Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-97ef5933-3e97-45ee-b277-71ba79381e5a" acquired by "delete_volume" :: waited 0.028s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-51f95910-f0ac-4767-8f28-a8dbd76055dc tempest-ProjectReaderTests-828871946 None] Lock "cinder-4c88d402-0e68-44fb-959e-4c93898a4d7f-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c50e99-c8b2-41b8-87ba-ba160af123e2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Flow 'volume_create_manager' (33c42d04-6659-4153-b71d-4cf9e82f358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90508e2-fbfe-4f25-980a-290ca15be2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90508e2-fbfe-4f25-980a-290ca15be2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734713798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7590cc6f-258f-40b9-94a3-2693069f85de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ece735f45478ab903d0b318fbe287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:11Z,use_quota=True,user_id='8ea7e2a54257455db5d59455abee9aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990b30f6-bdf1-4cf2-a32d-e32939e79207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990b30f6-bdf1-4cf2-a32d-e32939e79207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33df5eaa-d5ea-45db-bccb-239576fdcd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33df5eaa-d5ea-45db-bccb-239576fdcd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7590cc6f-258f-40b9-94a3-2693069f85de', 'volume_name': 'volume-7590cc6f-258f-40b9-94a3-2693069f85de', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:10 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a Jul 11 19:03:10 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabd5d56-63cb-47b2-bdab-b4c71e6cb534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabd5d56-63cb-47b2-bdab-b4c71e6cb534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0c3ef9-e9e6-4fa7-bde9-9a79bcf96c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:10 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Volume 7590cc6f-258f-40b9-94a3-2693069f85de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7590cc6f-258f-40b9-94a3-2693069f85de', 'volume_size': 1} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734713798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7590cc6f-258f-40b9-94a3-2693069f85de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ece735f45478ab903d0b318fbe287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:11Z,use_quota=True,user_id='8ea7e2a54257455db5d59455abee9aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Creating volume 7590cc6f-258f-40b9-94a3-2693069f85de {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:03:10 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:03:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:10 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de 1073741824 Jul 11 19:03:10 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:11 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a" returned: 0 in 0.843s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:11 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a Jul 11 19:03:11 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:11 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de 1073741824" returned: 0 in 0.961s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:11 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de Jul 11 19:03:11 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:12 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-97ef5933-3e97-45ee-b277-71ba79381e5a" returned: 0 in 0.739s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-97ef5933-3e97-45ee-b277-71ba79381e5a" released by "delete_volume" :: held 1.675s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Created reservations ['148e4888-c4f5-4220-a330-c87d0979d18e', '4b723246-6c09-4737-8c1d-bd9dd458a0c6', 'ef3b140e-e853-49ba-a4a2-0a0134719eac', '37b2b20e-6e9e-4e07-a84e-3b7e3d9b203e'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:12 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:12 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:12 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de" returned: 0 in 0.674s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0c3ef9-e9e6-4fa7-bde9-9a79bcf96c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7590cc6f-258f-40b9-94a3-2693069f85de', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99a3ad9-7ed7-4ba9-999f-3e869684443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:12 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Volume volume-7590cc6f-258f-40b9-94a3-2693069f85de (7590cc6f-258f-40b9-94a3-2693069f85de): created successfully Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99a3ad9-7ed7-4ba9-999f-3e869684443c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Flow 'volume_create_manager' (33c42d04-6659-4153-b71d-4cf9e82f358b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:12 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-983d5779-f36b-44e9-b410-55eac1e319e3 tempest-ProjectReaderTests-828871946 None] Created volume successfully. Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Acquiring lock "cinder-7590cc6f-258f-40b9-94a3-2693069f85de-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:12 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Lock "cinder-7590cc6f-258f-40b9-94a3-2693069f85de-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Acquiring lock "cinder-quobyte-7590cc6f-258f-40b9-94a3-2693069f85de" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Lock "cinder-quobyte-7590cc6f-258f-40b9-94a3-2693069f85de" acquired by "delete_volume" :: waited 0.022s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eb25c5-b303-4c4a-b74f-b64e8ad24b52]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:13 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de Jul 11 19:03:13 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:13 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.867s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:13 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Deleted volume successfully. Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8e062eff-2a43-407a-9463-0d7e271cf163 tempest-ProjectMemberTests-884888780 None] Lock "cinder-97ef5933-3e97-45ee-b277-71ba79381e5a-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (d43d8c2a-dd73-4f1e-a692-b716ccbebb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66d56f1-45d2-4165-8487-4bc179e2639a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66d56f1-45d2-4165-8487-4bc179e2639a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1550416673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f99f40c-a58a-48aa-8ac5-eefcefd74f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:13Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90803b30-9f7e-4b13-979e-1bbf55d77451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90803b30-9f7e-4b13-979e-1bbf55d77451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce3c3d8-d9c9-4fc4-8318-9acbe49adb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce3c3d8-d9c9-4fc4-8318-9acbe49adb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f99f40c-a58a-48aa-8ac5-eefcefd74f91', 'volume_name': 'volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0decd9af-5c00-4805-aed2-b7f273db64fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0decd9af-5c00-4805-aed2-b7f273db64fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b4d7a6-6f42-4604-b161-d9d34bc7c793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:13 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Volume 8f99f40c-a58a-48aa-8ac5-eefcefd74f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91', 'volume_size': 1} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1550416673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f99f40c-a58a-48aa-8ac5-eefcefd74f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:13Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Creating volume 8f99f40c-a58a-48aa-8ac5-eefcefd74f91 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:03:13 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:13 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 1073741824 Jul 11 19:03:13 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:13 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de" returned: 0 in 0.852s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:13 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de Jul 11 19:03:14 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:14 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 1073741824" returned: 0 in 0.916s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:14 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 Jul 11 19:03:14 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:14 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-7590cc6f-258f-40b9-94a3-2693069f85de" returned: 0 in 0.760s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Lock "cinder-quobyte-7590cc6f-258f-40b9-94a3-2693069f85de" released by "delete_volume" :: held 1.679s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Created reservations ['5486f6a8-a551-4e27-bd33-63ce6d23d5fd', '1f0a1943-102b-4f42-9136-1ee50bca0d0f', 'e27bcac7-dd3e-4693-bf7c-38766f344d28', 'b7334e2a-f77d-475b-807f-203051e3a6ee'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:14 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:14 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:15 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" returned: 0 in 0.772s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b4d7a6-6f42-4604-b161-d9d34bc7c793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88a40ef-afbe-432f-b6ff-726dddb60253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:15 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Volume volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 (8f99f40c-a58a-48aa-8ac5-eefcefd74f91): created successfully Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88a40ef-afbe-432f-b6ff-726dddb60253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (d43d8c2a-dd73-4f1e-a692-b716ccbebb94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6e3c2cbe-b6a8-46d5-a873-7243ff181a24 tempest-ProjectMemberTests-884888780 None] Created volume successfully. Jul 11 19:03:15 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.884s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:15 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Deleted volume successfully. Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-03ac3eef-bef7-44a2-a138-b35b49ee385e tempest-ProjectReaderTests-828871946 None] Lock "cinder-7590cc6f-258f-40b9-94a3-2693069f85de-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Creating offline snapshot c005190d-d33d-44c7-94e6-a3f391e2e4d8 of volume 8f99f40c-a58a-48aa-8ac5-eefcefd74f91 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Flow 'volume_create_manager' (c87c55a6-584c-4164-8440-eec334672939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feec9570-1874-46d9-941c-d4dba7b540b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81866f3-c0ed-49cc-b6c2-80a51f5c2bc3]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feec9570-1874-46d9-941c-d4dba7b540b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1719924182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2606bad9-6c7a-48d8-b934-f9bc0e8c828f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ece735f45478ab903d0b318fbe287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:16Z,use_quota=True,user_id='8ea7e2a54257455db5d59455abee9aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d38d61c-9d9c-4e44-bab4-b0b37b406f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d38d61c-9d9c-4e44-bab4-b0b37b406f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20063af-e0c3-4182-b2eb-46e5e3cd0961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20063af-e0c3-4182-b2eb-46e5e3cd0961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2606bad9-6c7a-48d8-b934-f9bc0e8c828f', 'volume_name': 'volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44714352-1a3b-4614-92fd-3611091fa513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44714352-1a3b-4614-92fd-3611091fa513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64ba206-6fc8-4ff9-bc90-bf4a724d1c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:16 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Volume 2606bad9-6c7a-48d8-b934-f9bc0e8c828f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f', 'volume_size': 1} Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:16 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 Jul 11 19:03:16 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:16 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" returned: 0 in 0.842s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:16 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 1G Jul 11 19:03:16 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:17 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 1G" returned: 0 in 0.794s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:17 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 Jul 11 19:03:17 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:18 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8" returned: 0 in 0.675s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:18 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 is being set with open permissions: ugo+rw Jul 11 19:03:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:18 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 Jul 11 19:03:18 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:18 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8" returned: 0 in 0.619s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:18 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.info Jul 11 19:03:18 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:19 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.info" returned: 0 in 0.645s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:19 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.info is being set with open permissions: ugo+rw Jul 11 19:03:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:19 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.info Jul 11 19:03:19 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:20 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.info" returned: 0 in 0.622s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.302s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.177s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1719924182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2606bad9-6c7a-48d8-b934-f9bc0e8c828f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b20ece735f45478ab903d0b318fbe287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:16Z,use_quota=True,user_id='8ea7e2a54257455db5d59455abee9aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Creating volume 2606bad9-6c7a-48d8-b934-f9bc0e8c828f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:03:20 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:03:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:20 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f 1073741824 Jul 11 19:03:20 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8c73506f-c9a4-4d9a-aeb7-5f7df3b556ee tempest-ProjectMemberTests-884888780 None] Create snapshot completed successfully Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-c005190d-d33d-44c7-94e6-a3f391e2e4d8-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Lock "cinder-c005190d-d33d-44c7-94e6-a3f391e2e4d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-c005190d-d33d-44c7-94e6-a3f391e2e4d8" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-c005190d-d33d-44c7-94e6-a3f391e2e4d8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Deleting offline snapshot c005190d-d33d-44c7-94e6-a3f391e2e4d8 of volume 8f99f40c-a58a-48aa-8ac5-eefcefd74f91 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] snapshot_file for this snap is: volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:03:21 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f 1073741824" returned: 0 in 0.832s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63e97b9-da42-45df-87f6-1e98b93768ca]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:21 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f Jul 11 19:03:21 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:21 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 Jul 11 19:03:21 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:21 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f" returned: 0 in 0.651s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64ba206-6fc8-4ff9-bc90-bf4a724d1c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a9169d-c1f0-4a1f-b6a6-0d84548a84ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:21 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Volume volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f (2606bad9-6c7a-48d8-b934-f9bc0e8c828f): created successfully Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a9169d-c1f0-4a1f-b6a6-0d84548a84ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Flow 'volume_create_manager' (c87c55a6-584c-4164-8440-eec334672939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:21 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8" returned: 0 in 0.765s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:03:21 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-71577c84-c219-4de2-a03f-78b830cbc295 tempest-ProjectReaderTests-828871946 None] Created volume successfully. Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a3bb9-110a-4e6f-9331-3c3e99e17f29]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:21 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 Jul 11 19:03:21 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Acquiring lock "cinder-2606bad9-6c7a-48d8-b934-f9bc0e8c828f-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Lock "cinder-2606bad9-6c7a-48d8-b934-f9bc0e8c828f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Acquiring lock "cinder-quobyte-2606bad9-6c7a-48d8-b934-f9bc0e8c828f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:22 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Lock "cinder-quobyte-2606bad9-6c7a-48d8-b934-f9bc0e8c828f" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:22 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cb3aea-68f2-4fea-9b1d-68339749f27f]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:22 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f Jul 11 19:03:22 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:22 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" returned: 0 in 0.731s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:22 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 Jul 11 19:03:22 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:22 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f" returned: 0 in 0.748s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:23 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f Jul 11 19:03:23 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:23 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8" returned: 0 in 0.752s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:23 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8 Jul 11 19:03:23 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:23 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-2606bad9-6c7a-48d8-b934-f9bc0e8c828f" returned: 0 in 0.647s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Lock "cinder-quobyte-2606bad9-6c7a-48d8-b934-f9bc0e8c828f" released by "delete_volume" :: held 1.437s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Created reservations ['0b0f8e6a-8b2d-4d90-942c-c0c9cdaad308', 'd847292d-eb2d-4393-a6c8-0a0268594719', '3accf084-b39f-4c65-9719-f2c0a0ec1026', 'ed487843-0229-4ae5-983d-8ce12ac4b75a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:23 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:23 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:24 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91.c005190d-d33d-44c7-94e6-a3f391e2e4d8" returned: 0 in 0.665s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-c005190d-d33d-44c7-94e6-a3f391e2e4d8" released by "_delete_snapshot" :: held 3.008s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" released by "delete_snapshot" :: held 3.031s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:24 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Created reservations ['44393d1e-ea32-46e9-b911-ec5a1408f1a1', '2df1874f-8348-4483-a914-fd27523af94b', 'c16f0621-b860-4637-a896-4f37c51e8ba2', '5a30ff6d-9a54-4e03-a19d-3a564c353486'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Delete snapshot completed successfully. Jul 11 19:03:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ffcf2979-1a98-4ffd-84d8-ecbb3c50a451 tempest-ProjectMemberTests-884888780 None] Lock "cinder-c005190d-d33d-44c7-94e6-a3f391e2e4d8-delete_snapshot" released by "delete_snapshot" :: held 3.187s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:24 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.662s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:24 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:24 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Deleted volume successfully. Jul 11 19:03:24 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-08ef70ae-6b64-4039-89ec-bea82da35bf8 tempest-ProjectReaderTests-828871946 None] Lock "cinder-2606bad9-6c7a-48d8-b934-f9bc0e8c828f-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-8f99f40c-a58a-48aa-8ac5-eefcefd74f91-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Lock "cinder-8f99f40c-a58a-48aa-8ac5-eefcefd74f91-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:25 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:25 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f198ddf-eb88-4185-998c-cb5c77849c07]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:25 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 Jul 11 19:03:25 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:26 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" returned: 0 in 0.820s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:26 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91 Jul 11 19:03:26 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:26 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" returned: 0 in 0.620s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-8f99f40c-a58a-48aa-8ac5-eefcefd74f91" released by "delete_volume" :: held 1.505s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Created reservations ['24f6e78c-7c1a-4b25-852e-7e69fa6ba321', 'a95d876e-031a-4b6e-a102-28d7307f8f8b', '5f99aba5-b6b1-4dba-b65c-bb62158c11ed', '158c9dc1-67ac-45f6-9021-63520bef1f9a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:26 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:26 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:27 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.647s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:27 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Deleted volume successfully. Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d385080c-bcd5-443b-9177-cb50a90b2340 tempest-ProjectMemberTests-884888780 None] Lock "cinder-8f99f40c-a58a-48aa-8ac5-eefcefd74f91-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (9573fcf7-0d62-49c5-a721-e0203a70b406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aaf0754-dac3-4e2e-b5ea-68fc0f4aaf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aaf0754-dac3-4e2e-b5ea-68fc0f4aaf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-354180514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9865919-c7cd-44b8-b203-a3d91a84f88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:28Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a08c1ba-7117-4c01-9ad0-f474bf6b7985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a08c1ba-7117-4c01-9ad0-f474bf6b7985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e61b60f-2874-49bc-947c-1001a9c144d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e61b60f-2874-49bc-947c-1001a9c144d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9865919-c7cd-44b8-b203-a3d91a84f88f', 'volume_name': 'volume-e9865919-c7cd-44b8-b203-a3d91a84f88f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae454720-223a-470f-9619-eb9b18e65007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae454720-223a-470f-9619-eb9b18e65007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ebea7b-a128-468f-ab10-0b574a2a4dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:27 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Volume e9865919-c7cd-44b8-b203-a3d91a84f88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9865919-c7cd-44b8-b203-a3d91a84f88f', 'volume_size': 1} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-354180514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9865919-c7cd-44b8-b203-a3d91a84f88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:28Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Creating volume e9865919-c7cd-44b8-b203-a3d91a84f88f {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:03:27 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:03:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:28 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f 1073741824 Jul 11 19:03:28 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:28 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f 1073741824" returned: 0 in 0.790s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:28 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f Jul 11 19:03:28 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:29 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f" returned: 0 in 0.642s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:03:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ebea7b-a128-468f-ab10-0b574a2a4dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9865919-c7cd-44b8-b203-a3d91a84f88f', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907d9cfb-3bbf-45f1-8e5e-b11a047e836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:29 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Volume volume-e9865919-c7cd-44b8-b203-a3d91a84f88f (e9865919-c7cd-44b8-b203-a3d91a84f88f): created successfully Jul 11 19:03:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907d9cfb-3bbf-45f1-8e5e-b11a047e836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (9573fcf7-0d62-49c5-a721-e0203a70b406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:29 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-0c1d3d24-8a5e-47a8-8c11-fcde1a104877 tempest-ProjectMemberTests-884888780 None] Created volume successfully. Jul 11 19:03:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Creating offline snapshot 955f5adc-cee6-4b4a-ab8e-b766a2fba631 of volume e9865919-c7cd-44b8-b203-a3d91a84f88f {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:03:30 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79b5911-48c1-4dde-a470-c02c209ea806]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:30 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f Jul 11 19:03:30 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:30 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f" returned: 0 in 0.726s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:30 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 1G Jul 11 19:03:30 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:31 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 1G" returned: 0 in 0.774s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9865919-c7cd-44b8-b203-a3d91a84f88f -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:31 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9865919-c7cd-44b8-b203-a3d91a84f88f -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 Jul 11 19:03:31 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:32 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9865919-c7cd-44b8-b203-a3d91a84f88f -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631" returned: 0 in 0.657s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:32 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 is being set with open permissions: ugo+rw Jul 11 19:03:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:32 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 Jul 11 19:03:32 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:32 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631" returned: 0 in 0.633s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:32 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.info Jul 11 19:03:32 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:33 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.info" returned: 0 in 0.645s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:33 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.info is being set with open permissions: ugo+rw Jul 11 19:03:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:33 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.info Jul 11 19:03:33 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:34 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.info" returned: 0 in 0.621s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.134s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:34 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-aedbf42b-a4e5-4a70-b8ae-2234ef2f5676 tempest-ProjectMemberTests-884888780 None] Create snapshot completed successfully Jul 11 19:03:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-955f5adc-cee6-4b4a-ab8e-b766a2fba631-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Lock "cinder-955f5adc-cee6-4b4a-ab8e-b766a2fba631-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-e9865919-c7cd-44b8-b203-a3d91a84f88f" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-e9865919-c7cd-44b8-b203-a3d91a84f88f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-955f5adc-cee6-4b4a-ab8e-b766a2fba631" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-955f5adc-cee6-4b4a-ab8e-b766a2fba631" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Deleting offline snapshot 955f5adc-cee6-4b4a-ab8e-b766a2fba631 of volume e9865919-c7cd-44b8-b203-a3d91a84f88f {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:03:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] snapshot_file for this snap is: volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:03:35 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8da26d-1b2a-49c8-af6a-63dd4e2c857d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:35 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 Jul 11 19:03:35 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:36 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631" returned: 0 in 0.722s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9865919-c7cd-44b8-b203-a3d91a84f88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:03:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[475bfb4d-d359-4126-aab1-4f7845e1820c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:36 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f Jul 11 19:03:36 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:36 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f" returned: 0 in 0.753s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:36 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 Jul 11 19:03:36 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:37 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631" returned: 0 in 0.693s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:37 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631 Jul 11 19:03:37 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:38 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f.955f5adc-cee6-4b4a-ab8e-b766a2fba631" returned: 0 in 0.634s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-955f5adc-cee6-4b4a-ab8e-b766a2fba631" released by "_delete_snapshot" :: held 2.885s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-e9865919-c7cd-44b8-b203-a3d91a84f88f" released by "delete_snapshot" :: held 2.911s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Created reservations ['2c779d71-83ec-47ce-bb59-27645ff6b173', '92711a79-301e-4854-8f47-be3ce8bc669b', 'a0d3827b-2e04-4b1f-837e-67245de0a9f1', '7d663506-6646-4289-a851-d5205946a9c2'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Delete snapshot completed successfully. Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1c494c5b-5249-4a15-ab8e-b216491a9692 tempest-ProjectMemberTests-884888780 None] Lock "cinder-955f5adc-cee6-4b4a-ab8e-b766a2fba631-delete_snapshot" released by "delete_snapshot" :: held 3.039s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-e9865919-c7cd-44b8-b203-a3d91a84f88f-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Lock "cinder-e9865919-c7cd-44b8-b203-a3d91a84f88f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-e9865919-c7cd-44b8-b203-a3d91a84f88f" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-e9865919-c7cd-44b8-b203-a3d91a84f88f" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c044191c-1310-4298-8698-fdc2fe1f7cff]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:38 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f Jul 11 19:03:38 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:39 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f" returned: 0 in 0.738s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:39 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f Jul 11 19:03:39 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:39 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e9865919-c7cd-44b8-b203-a3d91a84f88f" returned: 0 in 0.627s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:39 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-e9865919-c7cd-44b8-b203-a3d91a84f88f" released by "delete_volume" :: held 1.418s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:40 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Created reservations ['944122ea-5a47-4784-a92e-e35d3b56742e', 'aa421b57-8c8c-4dd8-9eab-c78d02815ebe', 'c5c9f8b6-fe49-414e-b6e9-61343af22703', '801f151e-7ee7-4135-952f-f81d074bd497'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:40 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:40 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:40 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.624s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:40 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Deleted volume successfully. Jul 11 19:03:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1e2ce866-0133-4ead-9145-9285ac255ce0 tempest-ProjectMemberTests-884888780 None] Lock "cinder-e9865919-c7cd-44b8-b203-a3d91a84f88f-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (590e9fca-dd7c-43fa-937b-80ebe713aed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f3d513-8393-4da8-80d1-6da2913d8f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f3d513-8393-4da8-80d1-6da2913d8f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596426362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba26630f-6b33-45c2-874e-2f00acc7dd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:41Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca636c74-7e1d-4ac4-abdc-b11d578b39e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca636c74-7e1d-4ac4-abdc-b11d578b39e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73eebbf-05ab-4f9c-ab78-c0edf6bad990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73eebbf-05ab-4f9c-ab78-c0edf6bad990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba26630f-6b33-45c2-874e-2f00acc7dd2a', 'volume_name': 'volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7bcfa5-b67c-4899-bb67-5f82b1035b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7bcfa5-b67c-4899-bb67-5f82b1035b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6230f575-3a38-4080-8dd9-60054d4e6359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:41 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Volume ba26630f-6b33-45c2-874e-2f00acc7dd2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a', 'volume_size': 1} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596426362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba26630f-6b33-45c2-874e-2f00acc7dd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:41Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Creating volume ba26630f-6b33-45c2-874e-2f00acc7dd2a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:03:41 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:41 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a 1073741824 Jul 11 19:03:41 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:41 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a 1073741824" returned: 0 in 0.771s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:42 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a Jul 11 19:03:42 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:42 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a" returned: 0 in 0.628s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:03:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6230f575-3a38-4080-8dd9-60054d4e6359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d1a03c-3e2e-4ca4-b567-fb3c00f8a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:42 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Volume volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a (ba26630f-6b33-45c2-874e-2f00acc7dd2a): created successfully Jul 11 19:03:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d1a03c-3e2e-4ca4-b567-fb3c00f8a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:42 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (590e9fca-dd7c-43fa-937b-80ebe713aed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:42 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ca9e164a-5d17-4a27-b622-b74e563a6170 tempest-ProjectMemberTests-884888780 None] Created volume successfully. Jul 11 19:03:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Creating offline snapshot 9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 of volume ba26630f-6b33-45c2-874e-2f00acc7dd2a {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:03:43 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8639238-0999-4e1e-917f-a13f994e29c3]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:43 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a Jul 11 19:03:43 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:44 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a" returned: 0 in 0.713s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:44 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 1G Jul 11 19:03:44 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:44 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 1G" returned: 0 in 0.784s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:44 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 Jul 11 19:03:44 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:45 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1" returned: 0 in 0.661s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:45 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 is being set with open permissions: ugo+rw Jul 11 19:03:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:45 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 Jul 11 19:03:45 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:46 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1" returned: 0 in 0.626s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:46 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.info Jul 11 19:03:46 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:46 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.info" returned: 0 in 0.636s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:46 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.info is being set with open permissions: ugo+rw Jul 11 19:03:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:46 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.info Jul 11 19:03:46 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:47 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.info" returned: 0 in 0.619s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.114s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b014f73b-cdbf-45aa-ab8c-1f22dee3c0c1 tempest-ProjectMemberTests-884888780 None] Create snapshot completed successfully Jul 11 19:03:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Lock "cinder-9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-ba26630f-6b33-45c2-874e-2f00acc7dd2a" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-ba26630f-6b33-45c2-874e-2f00acc7dd2a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:48 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Deleting offline snapshot 9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 of volume ba26630f-6b33-45c2-874e-2f00acc7dd2a {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:03:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] snapshot_file for this snap is: volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:03:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0aa2be-2f61-4105-8a7d-2947adb7e906]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:48 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 Jul 11 19:03:48 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:49 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1" returned: 0 in 0.735s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:49 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:03:49 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f9731-fc18-485c-bf82-01e6557b6cfe]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:49 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a Jul 11 19:03:49 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:50 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a" returned: 0 in 0.735s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:50 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 Jul 11 19:03:50 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:50 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1" returned: 0 in 0.698s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:50 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1 Jul 11 19:03:50 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:51 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:51 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:51 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a.9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1" returned: 0 in 0.646s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1" released by "_delete_snapshot" :: held 2.905s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-ba26630f-6b33-45c2-874e-2f00acc7dd2a" released by "delete_snapshot" :: held 2.930s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Created reservations ['33389634-0629-4e1d-80f7-574e5ac6b220', '336fc2be-bf72-4bb8-89c1-0cb566e1479e', '9f488e09-41fc-40b8-b2df-3b9c14779990', 'c38c0d18-b3dd-4f18-9a9c-45b7eda5e005'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:51 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Delete snapshot completed successfully. Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-2878df27-761b-4276-bd4b-8112ecc14b85 tempest-ProjectMemberTests-884888780 None] Lock "cinder-9f63ed2f-5ebd-47ff-8f0d-31b953ecefd1-delete_snapshot" released by "delete_snapshot" :: held 3.060s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-ba26630f-6b33-45c2-874e-2f00acc7dd2a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Lock "cinder-ba26630f-6b33-45c2-874e-2f00acc7dd2a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-ba26630f-6b33-45c2-874e-2f00acc7dd2a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-ba26630f-6b33-45c2-874e-2f00acc7dd2a" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df859f3-dd33-4110-ba2a-50998e8bdb7b]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:51 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a Jul 11 19:03:51 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:52 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.649s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:03:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:03:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:03:52 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a" returned: 0 in 0.735s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:52 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a Jul 11 19:03:52 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:53 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ba26630f-6b33-45c2-874e-2f00acc7dd2a" returned: 0 in 0.637s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-ba26630f-6b33-45c2-874e-2f00acc7dd2a" released by "delete_volume" :: held 1.431s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:53 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Created reservations ['6500530b-62b6-4270-afda-8ab61de210c0', '040164f5-4387-447b-9275-73fcb5e73492', '26566df4-fa7e-40fd-8e08-0e531eb86d70', '468cebd5-935e-4f07-9a73-cefec7e2e536'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:03:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:53 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:53 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:03:53 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:54 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.632s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:03:54 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Deleted volume successfully. Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f5a255a6-ec47-474e-8777-4e8d77023162 tempest-ProjectMemberTests-884888780 None] Lock "cinder-ba26630f-6b33-45c2-874e-2f00acc7dd2a-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (47157da6-56c6-43e8-b990-ad4995d3b0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37230bf7-9dc9-452d-8391-4ca25b0dd4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37230bf7-9dc9-452d-8391-4ca25b0dd4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719852670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90c84d2-f689-4c10-a078-2260fee83da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:54Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa33cb9-c72d-462d-908e-93b6e79bc734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa33cb9-c72d-462d-908e-93b6e79bc734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e314d9-082b-4b9d-adc0-02c78211ed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e314d9-082b-4b9d-adc0-02c78211ed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90c84d2-f689-4c10-a078-2260fee83da0', 'volume_name': 'volume-b90c84d2-f689-4c10-a078-2260fee83da0', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6718cd7-69ae-427f-94cb-69b7bd4b37e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6718cd7-69ae-427f-94cb-69b7bd4b37e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b341ec74-0d64-43be-99c0-9721368d1310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:54 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Volume b90c84d2-f689-4c10-a078-2260fee83da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90c84d2-f689-4c10-a078-2260fee83da0', 'volume_size': 1} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719852670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90c84d2-f689-4c10-a078-2260fee83da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:03:54Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Creating volume b90c84d2-f689-4c10-a078-2260fee83da0 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:03:54 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:03:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:54 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 1073741824 Jul 11 19:03:54 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:55 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 1073741824" returned: 0 in 0.791s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:55 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 Jul 11 19:03:55 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:55 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0" returned: 0 in 0.632s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:55 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:03:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:03:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b341ec74-0d64-43be-99c0-9721368d1310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90c84d2-f689-4c10-a078-2260fee83da0', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cbd3c1-6b65-4783-ab1e-3e091ed8d95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:03:55 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Volume volume-b90c84d2-f689-4c10-a078-2260fee83da0 (b90c84d2-f689-4c10-a078-2260fee83da0): created successfully Jul 11 19:03:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cbd3c1-6b65-4783-ab1e-3e091ed8d95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:03:55 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (47157da6-56c6-43e8-b990-ad4995d3b0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:03:55 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-a57ce37d-f6b5-481b-bf56-ffda255d8ad9 tempest-ProjectMemberTests-884888780 None] Created volume successfully. Jul 11 19:03:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:03:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:03:56 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Creating offline snapshot 58dd06b9-6cf9-42f3-9b61-52deb100a43e of volume b90c84d2-f689-4c10-a078-2260fee83da0 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:03:56 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8366133e-8c9f-4c51-8d8a-b709afed2789]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:03:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:56 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 Jul 11 19:03:56 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:57 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0" returned: 0 in 0.732s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:57 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:57 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e 1G Jul 11 19:03:57 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:58 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e 1G" returned: 0 in 0.780s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b90c84d2-f689-4c10-a078-2260fee83da0 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:58 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b90c84d2-f689-4c10-a078-2260fee83da0 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e Jul 11 19:03:58 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:58 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b90c84d2-f689-4c10-a078-2260fee83da0 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e" returned: 0 in 0.659s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:58 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e is being set with open permissions: ugo+rw Jul 11 19:03:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:58 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e Jul 11 19:03:58 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:03:59 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 11 19:03:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e" returned: 0 in 0.626s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:03:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:03:59 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.info Jul 11 19:03:59 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:00 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.info" returned: 0 in 0.628s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:00 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.info is being set with open permissions: ugo+rw Jul 11 19:04:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:00 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.info Jul 11 19:04:00 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:00 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.info" returned: 0 in 0.618s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.114s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:00 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d35d646d-6bbe-4a8d-ae86-730dd0a8d8d7 tempest-ProjectMemberTests-884888780 None] Create snapshot completed successfully Jul 11 19:04:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-58dd06b9-6cf9-42f3-9b61-52deb100a43e-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Lock "cinder-58dd06b9-6cf9-42f3-9b61-52deb100a43e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-b90c84d2-f689-4c10-a078-2260fee83da0" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-b90c84d2-f689-4c10-a078-2260fee83da0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-58dd06b9-6cf9-42f3-9b61-52deb100a43e" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-58dd06b9-6cf9-42f3-9b61-52deb100a43e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Deleting offline snapshot 58dd06b9-6cf9-42f3-9b61-52deb100a43e of volume b90c84d2-f689-4c10-a078-2260fee83da0 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:04:01 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] snapshot_file for this snap is: volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:04:01 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c1283a-d311-409f-9ade-5c31a9caf9c2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:01 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e Jul 11 19:04:01 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:02 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e" returned: 0 in 0.731s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b90c84d2-f689-4c10-a078-2260fee83da0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:04:02 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e50eb9c-b191-4f84-b32e-15459beb2b11]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:02 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 Jul 11 19:04:02 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:03 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0" returned: 0 in 0.736s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:03 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e Jul 11 19:04:03 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:04 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e" returned: 0 in 0.693s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:04 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e Jul 11 19:04:04 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:04 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0.58dd06b9-6cf9-42f3-9b61-52deb100a43e" returned: 0 in 0.622s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-58dd06b9-6cf9-42f3-9b61-52deb100a43e" released by "_delete_snapshot" :: held 2.873s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-b90c84d2-f689-4c10-a078-2260fee83da0" released by "delete_snapshot" :: held 2.897s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=103,cinder:INSERT=38,cinder:UPDATE=133,cinder:DELETE=8 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=93,cinder:UPDATE=131,cinder:INSERT=32,cinder:DELETE=14 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Created reservations ['517545a9-54d3-4d25-85df-3241744c43da', '29f7313b-9521-4006-89b2-94b4db41e3be', '51631d6a-72d0-4713-94d0-ac8c0b20f238', 'ff5ea67a-d5ee-4ff0-afa2-f75ea31ee4b2'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:04 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Delete snapshot completed successfully. Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-1dcf9c32-e0c3-4640-b3e5-837e37f13a60 tempest-ProjectMemberTests-884888780 None] Lock "cinder-58dd06b9-6cf9-42f3-9b61-52deb100a43e-delete_snapshot" released by "delete_snapshot" :: held 3.045s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-b90c84d2-f689-4c10-a078-2260fee83da0-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:04 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Lock "cinder-b90c84d2-f689-4c10-a078-2260fee83da0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-b90c84d2-f689-4c10-a078-2260fee83da0" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:05 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-b90c84d2-f689-4c10-a078-2260fee83da0" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:05 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f8964-a6a0-40e2-ba57-a5b4c63c2dca]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:05 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 Jul 11 19:04:05 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:05 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0" returned: 0 in 0.765s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:05 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0 Jul 11 19:04:05 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:06 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-b90c84d2-f689-4c10-a078-2260fee83da0" returned: 0 in 0.621s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:06 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-b90c84d2-f689-4c10-a078-2260fee83da0" released by "delete_volume" :: held 1.441s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:06 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Created reservations ['800c05f5-72f7-4232-bde4-acbb2a5d817b', '2c3a2174-9748-47a5-8d36-31c60fbe198d', '7ad1e9a5-8fbf-4129-a121-429fd0b384e3', '94f1a31f-1c75-4d25-92a6-606b37edb2f5'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:06 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:04:06 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:07 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.627s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:07 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Deleted volume successfully. Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-b412e786-7c86-4601-8af3-5fa30db24b6c tempest-ProjectMemberTests-884888780 None] Lock "cinder-b90c84d2-f689-4c10-a078-2260fee83da0-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (97451ef8-c203-4d12-8e66-1e5ac7194fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f6ffa4-9c44-4c36-a3d4-c3f860d8fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f6ffa4-9c44-4c36-a3d4-c3f860d8fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1268649337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52296964-38e4-4264-9018-7e1ecea93497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:08Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f29115d-625e-4058-b86d-fc9173281b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f29115d-625e-4058-b86d-fc9173281b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85dd774a-89c4-46c2-b24e-067167304cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85dd774a-89c4-46c2-b24e-067167304cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52296964-38e4-4264-9018-7e1ecea93497', 'volume_name': 'volume-52296964-38e4-4264-9018-7e1ecea93497', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c7804e-d766-4854-a80f-acaa93a9b38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c7804e-d766-4854-a80f-acaa93a9b38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8755d03a-b1d0-4f81-8c67-d4d48f63a25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:07 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Volume 52296964-38e4-4264-9018-7e1ecea93497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52296964-38e4-4264-9018-7e1ecea93497', 'volume_size': 1} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1268649337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52296964-38e4-4264-9018-7e1ecea93497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:08Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Creating volume 52296964-38e4-4264-9018-7e1ecea93497 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:07 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:04:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:07 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 1073741824 Jul 11 19:04:07 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:08 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 1073741824" returned: 0 in 0.824s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:08 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 Jul 11 19:04:08 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:09 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497" returned: 0 in 0.633s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8755d03a-b1d0-4f81-8c67-d4d48f63a25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52296964-38e4-4264-9018-7e1ecea93497', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2afa4c2-af81-42d0-ba83-45d14912f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:09 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Volume volume-52296964-38e4-4264-9018-7e1ecea93497 (52296964-38e4-4264-9018-7e1ecea93497): created successfully Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2afa4c2-af81-42d0-ba83-45d14912f872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (97451ef8-c203-4d12-8e66-1e5ac7194fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:09 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-044688bf-0287-4400-a6f0-57b53518fd0c tempest-ProjectMemberTests-884888780 None] Created volume successfully. Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Creating offline snapshot fb41c6e3-e0f6-4e71-855f-c8664cf0c796 of volume 52296964-38e4-4264-9018-7e1ecea93497 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f5ec3a-7a44-49e9-8d42-cb592599b4e3]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:09 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 Jul 11 19:04:09 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:10 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497" returned: 0 in 0.746s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:10 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 1G Jul 11 19:04:10 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:11 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 1G" returned: 0 in 0.769s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52296964-38e4-4264-9018-7e1ecea93497 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:11 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52296964-38e4-4264-9018-7e1ecea93497 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 Jul 11 19:04:11 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:12 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52296964-38e4-4264-9018-7e1ecea93497 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796" returned: 0 in 0.673s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:12 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 is being set with open permissions: ugo+rw Jul 11 19:04:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:12 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 Jul 11 19:04:12 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:12 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796" returned: 0 in 0.623s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:12 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.info Jul 11 19:04:12 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:13 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.info" returned: 0 in 0.625s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:13 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.info is being set with open permissions: ugo+rw Jul 11 19:04:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:13 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.info Jul 11 19:04:13 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:13 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.info" returned: 0 in 0.616s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.133s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:13 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-455fa6be-ecec-418f-97f8-02fa1e9ab25d tempest-ProjectMemberTests-884888780 None] Create snapshot completed successfully Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-fb41c6e3-e0f6-4e71-855f-c8664cf0c796-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Lock "cinder-fb41c6e3-e0f6-4e71-855f-c8664cf0c796-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-52296964-38e4-4264-9018-7e1ecea93497" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-52296964-38e4-4264-9018-7e1ecea93497" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-fb41c6e3-e0f6-4e71-855f-c8664cf0c796" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-fb41c6e3-e0f6-4e71-855f-c8664cf0c796" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Deleting offline snapshot fb41c6e3-e0f6-4e71-855f-c8664cf0c796 of volume 52296964-38e4-4264-9018-7e1ecea93497 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] snapshot_file for this snap is: volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[44245094-1085-46b1-acd0-ffa56d205d06]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:15 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 Jul 11 19:04:15 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:15 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796" returned: 0 in 0.743s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52296964-38e4-4264-9018-7e1ecea93497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2edf02-ed8e-49c3-aa7d-3b19a9f79ea7]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:15 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 Jul 11 19:04:15 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:16 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497" returned: 0 in 0.740s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:16 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 Jul 11 19:04:16 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:17 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796" returned: 0 in 0.692s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:17 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796 Jul 11 19:04:17 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:17 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497.fb41c6e3-e0f6-4e71-855f-c8664cf0c796" returned: 0 in 0.624s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-fb41c6e3-e0f6-4e71-855f-c8664cf0c796" released by "_delete_snapshot" :: held 2.886s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:17 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-52296964-38e4-4264-9018-7e1ecea93497" released by "delete_snapshot" :: held 2.911s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:18 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Created reservations ['694c0f69-6af5-44af-979a-3eda35957981', 'dc608673-5159-4bea-926e-63257032d49d', 'd744ce30-fa3e-4358-a005-de21e754c3e9', '69fe802e-cc6a-4cc4-8d88-4b9115eda812'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Delete snapshot completed successfully. Jul 11 19:04:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-7e7d697c-63d7-4246-970f-c9d30e0f2c17 tempest-ProjectMemberTests-884888780 None] Lock "cinder-fb41c6e3-e0f6-4e71-855f-c8664cf0c796-delete_snapshot" released by "delete_snapshot" :: held 3.035s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-52296964-38e4-4264-9018-7e1ecea93497-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Lock "cinder-52296964-38e4-4264-9018-7e1ecea93497-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-52296964-38e4-4264-9018-7e1ecea93497" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:18 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-52296964-38e4-4264-9018-7e1ecea93497" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:18 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[67378003-fb2d-4c16-a6ee-173412421154]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:18 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 Jul 11 19:04:18 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:19 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497" returned: 0 in 0.733s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:19 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497 Jul 11 19:04:19 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:19 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-52296964-38e4-4264-9018-7e1ecea93497" returned: 0 in 0.609s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-52296964-38e4-4264-9018-7e1ecea93497" released by "delete_volume" :: held 1.395s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Created reservations ['1f14b647-f678-45b3-a539-7a2945899c38', 'd6de5a84-5733-43a6-8bdf-f3bbd128f9bc', 'fc7b71f4-36fa-46cb-985c-da6408ee0232', 'c0be3802-db7e-4c09-92c5-e0d854827b9c'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:19 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:04:19 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:20 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.605s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:20 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Deleted volume successfully. Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-eee320f4-9396-410a-9357-e5194b7d5a02 tempest-ProjectMemberTests-884888780 None] Lock "cinder-52296964-38e4-4264-9018-7e1ecea93497-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (fea3b5ed-f423-4e48-8c66-ab09c1ab5003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317680a1-b9cd-4b36-9b18-07f772bf15e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317680a1-b9cd-4b36-9b18-07f772bf15e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1115668461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a26592c-e7e4-429e-97fa-d3a678b113ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:21Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73d46e6-10e8-4eef-812f-04fbe91a829f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73d46e6-10e8-4eef-812f-04fbe91a829f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645969a4-044d-49b4-8021-8497c1884ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645969a4-044d-49b4-8021-8497c1884ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a26592c-e7e4-429e-97fa-d3a678b113ca', 'volume_name': 'volume-9a26592c-e7e4-429e-97fa-d3a678b113ca', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c5ea01-3bff-4dee-8bbd-08c1b5f535a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c5ea01-3bff-4dee-8bbd-08c1b5f535a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba663efd-97f3-4cd7-86ed-08a9f046a7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:20 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Volume 9a26592c-e7e4-429e-97fa-d3a678b113ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a26592c-e7e4-429e-97fa-d3a678b113ca', 'volume_size': 1} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1115668461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a26592c-e7e4-429e-97fa-d3a678b113ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:21Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Creating volume 9a26592c-e7e4-429e-97fa-d3a678b113ca {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:20 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:04:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:20 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca 1073741824 Jul 11 19:04:20 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:21 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca 1073741824" returned: 0 in 0.785s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:21 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca Jul 11 19:04:21 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:22 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca" returned: 0 in 0.627s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:22 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba663efd-97f3-4cd7-86ed-08a9f046a7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a26592c-e7e4-429e-97fa-d3a678b113ca', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae74c5c-ec59-49e7-a2b2-9ef8353840ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:22 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Volume volume-9a26592c-e7e4-429e-97fa-d3a678b113ca (9a26592c-e7e4-429e-97fa-d3a678b113ca): created successfully Jul 11 19:04:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae74c5c-ec59-49e7-a2b2-9ef8353840ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:22 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (fea3b5ed-f423-4e48-8c66-ab09c1ab5003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:22 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3b225527-eb00-459a-9773-076f83d59f0a tempest-ProjectMemberTests-884888780 None] Created volume successfully. Jul 11 19:04:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Creating offline snapshot 3f4923c2-4b4b-478b-adb2-7e5b7026568e of volume 9a26592c-e7e4-429e-97fa-d3a678b113ca {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:04:23 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[3955d1da-6177-4e0b-9b04-54d069cd8b45]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:23 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca Jul 11 19:04:23 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:23 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca" returned: 0 in 0.726s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:23 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e 1G Jul 11 19:04:23 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:24 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e 1G" returned: 0 in 0.767s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a26592c-e7e4-429e-97fa-d3a678b113ca -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:24 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a26592c-e7e4-429e-97fa-d3a678b113ca -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e Jul 11 19:04:24 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:25 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a26592c-e7e4-429e-97fa-d3a678b113ca -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e" returned: 0 in 0.671s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:25 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e is being set with open permissions: ugo+rw Jul 11 19:04:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:25 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e Jul 11 19:04:25 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:25 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e" returned: 0 in 0.630s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:25 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.info Jul 11 19:04:25 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:26 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.info" returned: 0 in 0.628s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:26 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.info is being set with open permissions: ugo+rw Jul 11 19:04:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:26 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.info Jul 11 19:04:26 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:27 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.info" returned: 0 in 0.634s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.129s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:27 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-6c54bd22-16e6-406d-818a-89251acad0a8 tempest-ProjectMemberTests-884888780 None] Create snapshot completed successfully Jul 11 19:04:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-3f4923c2-4b4b-478b-adb2-7e5b7026568e-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Lock "cinder-3f4923c2-4b4b-478b-adb2-7e5b7026568e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-9a26592c-e7e4-429e-97fa-d3a678b113ca" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-9a26592c-e7e4-429e-97fa-d3a678b113ca" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-3f4923c2-4b4b-478b-adb2-7e5b7026568e" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-3f4923c2-4b4b-478b-adb2-7e5b7026568e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Deleting offline snapshot 3f4923c2-4b4b-478b-adb2-7e5b7026568e of volume 9a26592c-e7e4-429e-97fa-d3a678b113ca {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:04:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] snapshot_file for this snap is: volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:04:28 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[277f9032-8b1e-4a32-8c49-7fffa434aa71]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:28 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e Jul 11 19:04:28 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:29 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e" returned: 0 in 0.725s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a26592c-e7e4-429e-97fa-d3a678b113ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:04:29 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[3103b0d1-f41f-486b-8f9b-ea4da56aa890]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:29 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca Jul 11 19:04:29 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:29 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca" returned: 0 in 0.762s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:29 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e Jul 11 19:04:29 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:30 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e" returned: 0 in 0.707s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:30 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e Jul 11 19:04:30 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:31 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca.3f4923c2-4b4b-478b-adb2-7e5b7026568e" returned: 0 in 0.625s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-3f4923c2-4b4b-478b-adb2-7e5b7026568e" released by "_delete_snapshot" :: held 2.908s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-9a26592c-e7e4-429e-97fa-d3a678b113ca" released by "delete_snapshot" :: held 2.931s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Created reservations ['ee82490d-f538-4f14-b2a0-8071ef01c8f6', '16de261e-38db-4280-be90-0a1217208a1e', 'a0392404-e006-4af5-affb-455829337462', 'd95e7c6f-7ee5-413a-b597-e06b4e106910'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:31 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Delete snapshot completed successfully. Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-73f39a7e-dec9-4d70-bc99-50b78c735dfb tempest-ProjectMemberTests-884888780 None] Lock "cinder-3f4923c2-4b4b-478b-adb2-7e5b7026568e-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-9a26592c-e7e4-429e-97fa-d3a678b113ca-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Lock "cinder-9a26592c-e7e4-429e-97fa-d3a678b113ca-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-9a26592c-e7e4-429e-97fa-d3a678b113ca" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-9a26592c-e7e4-429e-97fa-d3a678b113ca" acquired by "delete_volume" :: waited 0.012s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bc70cb-87f1-447e-a86d-3ed7df9466cd]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:31 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca Jul 11 19:04:31 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:32 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca" returned: 0 in 0.722s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:32 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca Jul 11 19:04:32 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:32 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-9a26592c-e7e4-429e-97fa-d3a678b113ca" returned: 0 in 0.617s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:32 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-9a26592c-e7e4-429e-97fa-d3a678b113ca" released by "delete_volume" :: held 1.387s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:32 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Created reservations ['2b0ca1db-beb9-4f12-8548-c30f997efaec', '7d908811-8dc9-443d-8d21-60f49e0fad0e', 'fa632271-c45c-4c4d-b2c7-d418ed749bc1', '306755da-2e6a-43ec-a89b-c5193e46544d'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:33 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:33 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:04:33 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:33 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.619s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:33 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:33 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Deleted volume successfully. Jul 11 19:04:33 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-5bcc78a4-ede0-4854-a7f5-bad7be967025 tempest-ProjectMemberTests-884888780 None] Lock "cinder-9a26592c-e7e4-429e-97fa-d3a678b113ca-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (7a72a451-f856-4275-aa32-8eeade5bd7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea82509-0c43-420c-9027-620b66c05f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea82509-0c43-420c-9027-620b66c05f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1953409706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f28c19-5373-47d2-af0b-ce9a1ef9289a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:34Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef91d66-9fb5-47a2-ad6a-d412d973fb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef91d66-9fb5-47a2-ad6a-d412d973fb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424f4651-237e-45c3-9c17-a9340c19f831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424f4651-237e-45c3-9c17-a9340c19f831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f28c19-5373-47d2-af0b-ce9a1ef9289a', 'volume_name': 'volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a8969b-9934-47a0-bc12-0621417f2bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a8969b-9934-47a0-bc12-0621417f2bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1534dc-3fc0-415a-8f95-d2cd90ca2eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:34 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Volume 51f28c19-5373-47d2-af0b-ce9a1ef9289a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a', 'volume_size': 1} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1953409706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f28c19-5373-47d2-af0b-ce9a1ef9289a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de1cf37bd8d4d949fc8e9aa095a009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:34Z,use_quota=True,user_id='ba4bd2ce12d94d60b5b87d83d2889749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Creating volume 51f28c19-5373-47d2-af0b-ce9a1ef9289a {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:34 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:34 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a 1073741824 Jul 11 19:04:34 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:34 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a 1073741824" returned: 0 in 0.774s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:34 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a Jul 11 19:04:34 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:35 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a" returned: 0 in 0.622s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1534dc-3fc0-415a-8f95-d2cd90ca2eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd52024-9314-4e79-852c-9d7f9ba1a051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:35 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Volume volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a (51f28c19-5373-47d2-af0b-ce9a1ef9289a): created successfully Jul 11 19:04:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd52024-9314-4e79-852c-9d7f9ba1a051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:35 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Flow 'volume_create_manager' (7a72a451-f856-4275-aa32-8eeade5bd7e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3ec4bcb7-f248-472f-9f59-62d4314441db tempest-ProjectMemberTests-884888780 None] Created volume successfully. Jul 11 19:04:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Creating offline snapshot e99ddd0a-7458-451a-8cfc-6e60b81b4635 of volume 51f28c19-5373-47d2-af0b-ce9a1ef9289a {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:04:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05ff17b-1d09-41ee-b1f5-45532a4f6163]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:36 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a Jul 11 19:04:36 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:37 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a" returned: 0 in 0.724s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:37 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 1G Jul 11 19:04:37 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:37 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 1G" returned: 0 in 0.762s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:37 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 Jul 11 19:04:37 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:38 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635" returned: 0 in 0.653s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:38 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 is being set with open permissions: ugo+rw Jul 11 19:04:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:38 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 Jul 11 19:04:38 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:39 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635" returned: 0 in 0.615s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:39 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.info Jul 11 19:04:39 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:39 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.info" returned: 0 in 0.616s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:39 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.info is being set with open permissions: ugo+rw Jul 11 19:04:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:39 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.info Jul 11 19:04:39 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:40 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.info" returned: 0 in 0.633s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.076s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-32ee279d-dbc2-41b5-9f10-d549e909c1eb tempest-ProjectMemberTests-884888780 None] Create snapshot completed successfully Jul 11 19:04:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-e99ddd0a-7458-451a-8cfc-6e60b81b4635-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Lock "cinder-e99ddd0a-7458-451a-8cfc-6e60b81b4635-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-51f28c19-5373-47d2-af0b-ce9a1ef9289a" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-51f28c19-5373-47d2-af0b-ce9a1ef9289a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-e99ddd0a-7458-451a-8cfc-6e60b81b4635" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-e99ddd0a-7458-451a-8cfc-6e60b81b4635" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Deleting offline snapshot e99ddd0a-7458-451a-8cfc-6e60b81b4635 of volume 51f28c19-5373-47d2-af0b-ce9a1ef9289a {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:04:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] snapshot_file for this snap is: volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:04:41 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5390be-250f-4c60-8429-bce3a1e98283]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:41 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 Jul 11 19:04:41 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:42 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635" returned: 0 in 0.731s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:42 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:04:42 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffab6f53-98b2-4893-9cad-1c8b48943b07]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:42 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a Jul 11 19:04:42 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:43 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a" returned: 0 in 0.719s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:43 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 Jul 11 19:04:43 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:43 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635" returned: 0 in 0.689s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:43 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635 Jul 11 19:04:43 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:44 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a.e99ddd0a-7458-451a-8cfc-6e60b81b4635" returned: 0 in 0.626s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-e99ddd0a-7458-451a-8cfc-6e60b81b4635" released by "_delete_snapshot" :: held 2.844s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-51f28c19-5373-47d2-af0b-ce9a1ef9289a" released by "delete_snapshot" :: held 2.865s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Created reservations ['fb9febb1-039d-463d-b4fd-32870ec2f8ad', '2da1d13d-d6f9-49b7-997d-0602515f3d3c', '0e4121fb-6627-4840-9bea-64bdb14ce97a', '85516b51-3f69-44f4-98a1-14a641788c60'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:44 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Delete snapshot completed successfully. Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-e10bed0a-f6a0-4c5b-8c79-62d5430817fe tempest-ProjectMemberTests-884888780 None] Lock "cinder-e99ddd0a-7458-451a-8cfc-6e60b81b4635-delete_snapshot" released by "delete_snapshot" :: held 2.986s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-51f28c19-5373-47d2-af0b-ce9a1ef9289a-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Lock "cinder-51f28c19-5373-47d2-af0b-ce9a1ef9289a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Acquiring lock "cinder-quobyte-51f28c19-5373-47d2-af0b-ce9a1ef9289a" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-51f28c19-5373-47d2-af0b-ce9a1ef9289a" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d1f952-d02b-4947-8e10-6b0f19bcd349]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:44 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a Jul 11 19:04:44 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:45 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a" returned: 0 in 0.721s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:45 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a Jul 11 19:04:45 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:46 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-51f28c19-5373-47d2-af0b-ce9a1ef9289a" returned: 0 in 0.629s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Lock "cinder-quobyte-51f28c19-5373-47d2-af0b-ce9a1ef9289a" released by "delete_volume" :: held 1.405s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Created reservations ['8f40e057-5eb7-44ac-8017-b9f8d7517d53', 'b02daafb-9c9c-49b9-addb-596b9d6308b5', '85a64494-18d6-4429-9abc-fd23e85d7571', '8de36cc8-8f2f-42e6-91d4-f9ab9e2c10f1'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:46 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:04:46 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:46 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.622s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:46 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Deleted volume successfully. Jul 11 19:04:46 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-d4bb0f85-6d8b-448f-a475-a9b7a1efb1c8 tempest-ProjectMemberTests-884888780 None] Lock "cinder-51f28c19-5373-47d2-af0b-ce9a1ef9289a-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Flow 'volume_create_manager' (9f7f3aa5-0361-4318-8cc0-7558a9c87ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e096c23-bb1f-4412-9b30-39f3a8316bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e096c23-bb1f-4412-9b30-39f3a8316bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682445572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20b5c8b-59b8-4d43-a430-225367a5ebb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c046a67d624d97a26388df0d1587dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:50Z,use_quota=True,user_id='102824f157a64a51943b75108aaf8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e02c168-bbb7-496f-9603-4c026684114a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e02c168-bbb7-496f-9603-4c026684114a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73358e35-9330-41e4-b915-777931155ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73358e35-9330-41e4-b915-777931155ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e20b5c8b-59b8-4d43-a430-225367a5ebb3', 'volume_name': 'volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff82860-1c5f-455a-8d25-3a7d6a8cf854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff82860-1c5f-455a-8d25-3a7d6a8cf854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0bd50e-8fa6-4dbb-852a-8588e6f967d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:50 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Volume e20b5c8b-59b8-4d43-a430-225367a5ebb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3', 'volume_size': 1} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682445572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20b5c8b-59b8-4d43-a430-225367a5ebb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c046a67d624d97a26388df0d1587dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:04:50Z,use_quota=True,user_id='102824f157a64a51943b75108aaf8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Creating volume e20b5c8b-59b8-4d43-a430-225367a5ebb3 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:04:50 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:04:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:50 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 1073741824 Jul 11 19:04:50 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:51 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 1073741824" returned: 0 in 0.775s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:51 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 Jul 11 19:04:51 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:04:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:04:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:04:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:51 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:04:51 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:51 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3" returned: 0 in 0.641s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0bd50e-8fa6-4dbb-852a-8588e6f967d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c89b1c-f794-4c2b-9590-14f07fa28250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:04:52 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Volume volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 (e20b5c8b-59b8-4d43-a430-225367a5ebb3): created successfully Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c89b1c-f794-4c2b-9590-14f07fa28250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Flow 'volume_create_manager' (9f7f3aa5-0361-4318-8cc0-7558a9c87ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:04:52 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.621s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:04:52 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-54dc02aa-f7cf-45e7-af40-f9a0938c9ae4 tempest-ProjectReaderTests-1006413965 None] Created volume successfully. Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Creating offline snapshot b8c95c89-9a84-4094-b164-de800199c3b5 of volume e20b5c8b-59b8-4d43-a430-225367a5ebb3 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b932d-dac1-46f9-a7fb-828109a622f8]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:52 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 Jul 11 19:04:52 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:53 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3" returned: 0 in 0.741s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:53 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 1G Jul 11 19:04:53 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:54 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 1G" returned: 0 in 0.752s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:54 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 Jul 11 19:04:54 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:54 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5" returned: 0 in 0.662s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:54 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 is being set with open permissions: ugo+rw Jul 11 19:04:54 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:54 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 Jul 11 19:04:54 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:55 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5" returned: 0 in 0.614s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:55 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:55 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.info Jul 11 19:04:55 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:56 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.info" returned: 0 in 0.624s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:56 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.info is being set with open permissions: ugo+rw Jul 11 19:04:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:56 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.info Jul 11 19:04:56 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:56 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.info" returned: 0 in 0.604s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:56 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.067s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:04:56 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-aef47efb-d840-43b1-828d-6f5d8c4ad140 tempest-ProjectReaderTests-1006413965 None] Create snapshot completed successfully Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-b8c95c89-9a84-4094-b164-de800199c3b5-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Lock "cinder-b8c95c89-9a84-4094-b164-de800199c3b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-e20b5c8b-59b8-4d43-a430-225367a5ebb3" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-e20b5c8b-59b8-4d43-a430-225367a5ebb3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-b8c95c89-9a84-4094-b164-de800199c3b5" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-b8c95c89-9a84-4094-b164-de800199c3b5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Deleting offline snapshot b8c95c89-9a84-4094-b164-de800199c3b5 of volume e20b5c8b-59b8-4d43-a430-225367a5ebb3 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] snapshot_file for this snap is: volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3852cb0-eb21-47a5-9786-62c6353804c5]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:58 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 Jul 11 19:04:58 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:58 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5" returned: 0 in 0.761s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aaa46c-8cac-421d-ba35-c3e200ac0bfb]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:04:58 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:58 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 Jul 11 19:04:58 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:04:59 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 11 19:04:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3" returned: 0 in 0.709s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:04:59 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:04:59 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 Jul 11 19:04:59 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:00 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5" returned: 0 in 0.688s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:00 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5 Jul 11 19:05:00 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:00 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:00 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3.b8c95c89-9a84-4094-b164-de800199c3b5" returned: 0 in 0.637s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:00 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-b8c95c89-9a84-4094-b164-de800199c3b5" released by "_delete_snapshot" :: held 2.877s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:00 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-e20b5c8b-59b8-4d43-a430-225367a5ebb3" released by "delete_snapshot" :: held 2.898s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:01 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Created reservations ['8b83c7eb-78fb-4c7f-b114-82ad2a5b8a7f', '4533677a-a321-4636-ba04-36c9a36823a7', 'b3627119-74c5-4bea-93ba-32cfb2c39d71', '3db6df02-b8b4-4593-b207-28db50941b9a'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:01 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Delete snapshot completed successfully. Jul 11 19:05:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-dc13f7d9-ff4a-4d78-a5bf-de24337d3fee tempest-ProjectReaderTests-1006413965 None] Lock "cinder-b8c95c89-9a84-4094-b164-de800199c3b5-delete_snapshot" released by "delete_snapshot" :: held 3.031s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-e20b5c8b-59b8-4d43-a430-225367a5ebb3-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Lock "cinder-e20b5c8b-59b8-4d43-a430-225367a5ebb3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-e20b5c8b-59b8-4d43-a430-225367a5ebb3" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:01 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-e20b5c8b-59b8-4d43-a430-225367a5ebb3" acquired by "delete_volume" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:01 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[25858132-bb09-4eb1-bb4f-e451978be144]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:01 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:01 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 Jul 11 19:05:01 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:02 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3" returned: 0 in 0.715s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:02 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3 Jul 11 19:05:02 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:02 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-e20b5c8b-59b8-4d43-a430-225367a5ebb3" returned: 0 in 0.607s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-e20b5c8b-59b8-4d43-a430-225367a5ebb3" released by "delete_volume" :: held 1.371s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Created reservations ['293c259a-08f4-4011-867d-ae3e2af6eb5d', 'cb3605da-37ba-4fb8-a793-76ec7fbee67c', '6ccb9384-f34c-4801-a9dc-a4039c673b49', 'f85235ad-0ffa-40d9-95f8-2dbe55c4a95d'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:02 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:02 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:05:02 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:03 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.654s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:03 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Deleted volume successfully. Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-c5fdc9d7-a885-4d4d-a6d6-cdbc0144063f tempest-ProjectReaderTests-1006413965 None] Lock "cinder-e20b5c8b-59b8-4d43-a430-225367a5ebb3-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Flow 'volume_create_manager' (6dbca1db-c8af-4cab-99fb-8731daa2a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba851194-1480-4943-ba61-fa9eb61c4d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba851194-1480-4943-ba61-fa9eb61c4d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-870991415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f69a2dc-b39f-48a4-9366-62e2e86672de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c046a67d624d97a26388df0d1587dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:04Z,use_quota=True,user_id='102824f157a64a51943b75108aaf8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab20c79-9b34-4539-baed-5b4ea5e63989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab20c79-9b34-4539-baed-5b4ea5e63989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49637785-e79b-4a46-827e-043b57b98899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49637785-e79b-4a46-827e-043b57b98899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f69a2dc-b39f-48a4-9366-62e2e86672de', 'volume_name': 'volume-4f69a2dc-b39f-48a4-9366-62e2e86672de', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f758ccf-b490-48b6-b647-d029a1e4093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f758ccf-b490-48b6-b647-d029a1e4093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0919c62c-d95b-49f8-b035-87a36236d120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:03 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Volume 4f69a2dc-b39f-48a4-9366-62e2e86672de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f69a2dc-b39f-48a4-9366-62e2e86672de', 'volume_size': 1} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-870991415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f69a2dc-b39f-48a4-9366-62e2e86672de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c046a67d624d97a26388df0d1587dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:04Z,use_quota=True,user_id='102824f157a64a51943b75108aaf8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Creating volume 4f69a2dc-b39f-48a4-9366-62e2e86672de {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:03 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:05:03 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:03 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de 1073741824 Jul 11 19:05:03 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:04 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de 1073741824" returned: 0 in 0.773s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:04 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:04 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de Jul 11 19:05:04 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:05 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de" returned: 0 in 0.618s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:05 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:05 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:05 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=59,cinder:INSERT=27,cinder:UPDATE=85,cinder:DELETE=8 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:05:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0919c62c-d95b-49f8-b035-87a36236d120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f69a2dc-b39f-48a4-9366-62e2e86672de', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635f3ef2-c1f3-4241-96e4-df1e5b95341b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:05 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:SELECT=74,cinder:INSERT=22,cinder:UPDATE=91,cinder:DELETE=5 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:05:05 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Volume volume-4f69a2dc-b39f-48a4-9366-62e2e86672de (4f69a2dc-b39f-48a4-9366-62e2e86672de): created successfully Jul 11 19:05:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635f3ef2-c1f3-4241-96e4-df1e5b95341b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:05 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Flow 'volume_create_manager' (6dbca1db-c8af-4cab-99fb-8731daa2a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:05 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d011a11c-11b8-46dd-8619-42c631424960 tempest-ProjectReaderTests-1006413965 None] Created volume successfully. Jul 11 19:05:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:06 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Creating offline snapshot 94aa3e44-4b39-411e-bdb9-cc8c7050ca97 of volume 4f69a2dc-b39f-48a4-9366-62e2e86672de {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:05:06 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e074a1-39e8-4316-96dd-c2db91fce05d]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:06 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de Jul 11 19:05:06 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:06 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de" returned: 0 in 0.728s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:06 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:06 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 1G Jul 11 19:05:06 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:07 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 1G" returned: 0 in 0.746s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:07 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f69a2dc-b39f-48a4-9366-62e2e86672de -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:07 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f69a2dc-b39f-48a4-9366-62e2e86672de -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 Jul 11 19:05:07 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:08 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f69a2dc-b39f-48a4-9366-62e2e86672de -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97" returned: 0 in 0.678s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:08 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 is being set with open permissions: ugo+rw Jul 11 19:05:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:08 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 Jul 11 19:05:08 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:08 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97" returned: 0 in 0.618s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:08 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:08 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.info Jul 11 19:05:08 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:09 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.info" returned: 0 in 0.640s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:09 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.info is being set with open permissions: ugo+rw Jul 11 19:05:09 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:09 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.info Jul 11 19:05:09 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:10 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.info" returned: 0 in 0.604s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:10 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.093s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:10 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-04b20687-15bc-4d5b-a851-973bb74107d5 tempest-ProjectReaderTests-1006413965 None] Create snapshot completed successfully Jul 11 19:05:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-94aa3e44-4b39-411e-bdb9-cc8c7050ca97-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Lock "cinder-94aa3e44-4b39-411e-bdb9-cc8c7050ca97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-4f69a2dc-b39f-48a4-9366-62e2e86672de" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-4f69a2dc-b39f-48a4-9366-62e2e86672de" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-94aa3e44-4b39-411e-bdb9-cc8c7050ca97" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:11 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-94aa3e44-4b39-411e-bdb9-cc8c7050ca97" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Deleting offline snapshot 94aa3e44-4b39-411e-bdb9-cc8c7050ca97 of volume 4f69a2dc-b39f-48a4-9366-62e2e86672de {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:05:11 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] snapshot_file for this snap is: volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:05:11 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb03d91c-c688-47e8-9c42-7600687233e9]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:11 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:11 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 Jul 11 19:05:11 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:12 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97" returned: 0 in 0.705s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:12 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f69a2dc-b39f-48a4-9366-62e2e86672de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:05:12 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd2b9bb-c21d-4e14-afc4-94d8f21c0a09]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:12 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de Jul 11 19:05:12 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:12 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de" returned: 0 in 0.721s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:12 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:12 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 Jul 11 19:05:12 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:13 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97" returned: 0 in 0.690s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:13 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:13 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97 Jul 11 19:05:13 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:14 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de.94aa3e44-4b39-411e-bdb9-cc8c7050ca97" returned: 0 in 0.621s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-94aa3e44-4b39-411e-bdb9-cc8c7050ca97" released by "_delete_snapshot" :: held 2.821s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-4f69a2dc-b39f-48a4-9366-62e2e86672de" released by "delete_snapshot" :: held 2.843s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Created reservations ['a78c026d-7fa2-4632-9303-65f4da661756', 'e0067bc4-d3e4-4e16-9400-2a87423064e4', '1a22bc76-6a61-45dc-a79b-ba8a3281a2c3', '9a660cd0-49fe-45a4-9c7d-1510be44b5cb'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:14 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Delete snapshot completed successfully. Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-21462f3e-8763-4d87-ab04-c36ff357e52c tempest-ProjectReaderTests-1006413965 None] Lock "cinder-94aa3e44-4b39-411e-bdb9-cc8c7050ca97-delete_snapshot" released by "delete_snapshot" :: held 2.966s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-4f69a2dc-b39f-48a4-9366-62e2e86672de-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-4f69a2dc-b39f-48a4-9366-62e2e86672de-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-4f69a2dc-b39f-48a4-9366-62e2e86672de" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-4f69a2dc-b39f-48a4-9366-62e2e86672de" acquired by "delete_volume" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[68944747-89ce-43a2-a594-8fc5ac286017]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:14 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:14 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de Jul 11 19:05:14 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:15 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de" returned: 0 in 0.734s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:15 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de Jul 11 19:05:15 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:15 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-4f69a2dc-b39f-48a4-9366-62e2e86672de" returned: 0 in 0.611s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:15 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-4f69a2dc-b39f-48a4-9366-62e2e86672de" released by "delete_volume" :: held 1.396s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:15 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Created reservations ['2641c821-03ff-4125-806c-2fd9e013425e', '3d9e232b-bfb9-451a-9eae-066459f04248', 'ffe53021-a49c-4e44-b756-3855567f4513', 'f1d9ae44-7551-4edb-835f-25888de72ba2'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:15 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:15 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:16 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:16 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:05:16 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:16 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:16 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.621s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:16 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:16 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Deleted volume successfully. Jul 11 19:05:16 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4091c467-f704-4d43-9766-0eb6a58b3194 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-4f69a2dc-b39f-48a4-9366-62e2e86672de-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Flow 'volume_create_manager' (a2474df1-31c0-4ea4-86ea-02032e5d6a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdff3cb-a268-412f-bd82-4acd36dad391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdff3cb-a268-412f-bd82-4acd36dad391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1167234684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3741a7fb-6b8b-4208-aa2f-d6968443434c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c046a67d624d97a26388df0d1587dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:17Z,use_quota=True,user_id='102824f157a64a51943b75108aaf8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902b95f3-742c-4b2a-b2ee-0d55ef71bbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902b95f3-742c-4b2a-b2ee-0d55ef71bbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88e1c3b-9110-4e3d-89ce-558f4d96afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88e1c3b-9110-4e3d-89ce-558f4d96afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3741a7fb-6b8b-4208-aa2f-d6968443434c', 'volume_name': 'volume-3741a7fb-6b8b-4208-aa2f-d6968443434c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b47654-75c0-47aa-a6fe-7202436546b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b47654-75c0-47aa-a6fe-7202436546b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d78ef0a-0c61-48d9-9fd8-0bef2b0e0b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:17 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Volume 3741a7fb-6b8b-4208-aa2f-d6968443434c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3741a7fb-6b8b-4208-aa2f-d6968443434c', 'volume_size': 1} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1167234684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3741a7fb-6b8b-4208-aa2f-d6968443434c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c046a67d624d97a26388df0d1587dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:17Z,use_quota=True,user_id='102824f157a64a51943b75108aaf8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Creating volume 3741a7fb-6b8b-4208-aa2f-d6968443434c {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:17 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:17 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c 1073741824 Jul 11 19:05:17 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:17 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c 1073741824" returned: 0 in 0.765s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:17 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:17 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c Jul 11 19:05:17 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:18 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c" returned: 0 in 0.615s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:18 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:18 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d78ef0a-0c61-48d9-9fd8-0bef2b0e0b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3741a7fb-6b8b-4208-aa2f-d6968443434c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7913d8bb-5e3b-4989-88d6-fc89d8c9ff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:18 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Volume volume-3741a7fb-6b8b-4208-aa2f-d6968443434c (3741a7fb-6b8b-4208-aa2f-d6968443434c): created successfully Jul 11 19:05:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7913d8bb-5e3b-4989-88d6-fc89d8c9ff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:18 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Flow 'volume_create_manager' (a2474df1-31c0-4ea4-86ea-02032e5d6a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:18 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ee5110de-99ee-4953-b8f7-ef36b7793f35 tempest-ProjectReaderTests-1006413965 None] Created volume successfully. Jul 11 19:05:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:19 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Creating offline snapshot eda0befd-ce1e-4ee5-a80a-af512bed632e of volume 3741a7fb-6b8b-4208-aa2f-d6968443434c {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:05:19 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[7320b976-fa9e-4c44-887f-a2b8caf2bcd2]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:19 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:19 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c Jul 11 19:05:19 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:20 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c" returned: 0 in 0.714s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:20 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e 1G Jul 11 19:05:20 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:20 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e 1G" returned: 0 in 0.746s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:20 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3741a7fb-6b8b-4208-aa2f-d6968443434c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:20 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3741a7fb-6b8b-4208-aa2f-d6968443434c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e Jul 11 19:05:20 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:21 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3741a7fb-6b8b-4208-aa2f-d6968443434c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e" returned: 0 in 0.661s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:21 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e is being set with open permissions: ugo+rw Jul 11 19:05:21 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:21 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e Jul 11 19:05:21 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:22 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e" returned: 0 in 0.609s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:22 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.info Jul 11 19:05:22 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:22 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.info" returned: 0 in 0.616s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:22 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.info is being set with open permissions: ugo+rw Jul 11 19:05:22 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:22 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.info Jul 11 19:05:22 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:23 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.info" returned: 0 in 0.612s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.033s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:23 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-2e31b859-c888-4752-bd6d-771d0af24720 tempest-ProjectReaderTests-1006413965 None] Create snapshot completed successfully Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-eda0befd-ce1e-4ee5-a80a-af512bed632e-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-eda0befd-ce1e-4ee5-a80a-af512bed632e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-3741a7fb-6b8b-4208-aa2f-d6968443434c" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-3741a7fb-6b8b-4208-aa2f-d6968443434c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-eda0befd-ce1e-4ee5-a80a-af512bed632e" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-eda0befd-ce1e-4ee5-a80a-af512bed632e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Deleting offline snapshot eda0befd-ce1e-4ee5-a80a-af512bed632e of volume 3741a7fb-6b8b-4208-aa2f-d6968443434c {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] snapshot_file for this snap is: volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f7839e-9e58-4d64-837f-5f1ad2971e13]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:23 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:23 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e Jul 11 19:05:23 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:24 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e" returned: 0 in 0.717s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:24 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3741a7fb-6b8b-4208-aa2f-d6968443434c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:05:24 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[475c34b3-f4c8-4877-80ed-9c1c32befe81]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:24 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c Jul 11 19:05:24 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:24 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c" returned: 0 in 0.709s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:24 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:25 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e Jul 11 19:05:25 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:25 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e" returned: 0 in 0.690s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:25 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:25 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e Jul 11 19:05:25 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:26 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c.eda0befd-ce1e-4ee5-a80a-af512bed632e" returned: 0 in 0.619s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-eda0befd-ce1e-4ee5-a80a-af512bed632e" released by "_delete_snapshot" :: held 2.813s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-3741a7fb-6b8b-4208-aa2f-d6968443434c" released by "delete_snapshot" :: held 2.834s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Created reservations ['6713c601-0c98-423a-90fe-46b66df59f63', 'dcc8c85f-3135-480b-bc83-5e5355f956d9', '39b5eb3e-5a7a-4119-8559-4b9f39da04c4', '00aa9788-7407-4087-8cc2-1923fd6d4013'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:26 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Delete snapshot completed successfully. Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-ca6a0612-4398-4de8-9571-8847d440fdb6 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-eda0befd-ce1e-4ee5-a80a-af512bed632e-delete_snapshot" released by "delete_snapshot" :: held 2.955s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-3741a7fb-6b8b-4208-aa2f-d6968443434c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Lock "cinder-3741a7fb-6b8b-4208-aa2f-d6968443434c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-3741a7fb-6b8b-4208-aa2f-d6968443434c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-3741a7fb-6b8b-4208-aa2f-d6968443434c" acquired by "delete_volume" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8f5829-2280-4e60-99c6-3098d0559fb5]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:26 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:26 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c Jul 11 19:05:26 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:27 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c" returned: 0 in 0.720s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:27 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:27 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c Jul 11 19:05:27 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:28 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-3741a7fb-6b8b-4208-aa2f-d6968443434c" returned: 0 in 0.614s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-3741a7fb-6b8b-4208-aa2f-d6968443434c" released by "delete_volume" :: held 1.381s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Created reservations ['414041d0-7d2a-41ad-b0ac-7f94db71f575', 'd75b8779-6134-4337-b04f-cacbac019d3b', 'a8fad64c-502b-4031-a9db-b05fb05aff60', '473ead26-8e06-4e5a-9a91-0380f5224c8f'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:28 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:05:28 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:28 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.615s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:28 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Deleted volume successfully. Jul 11 19:05:28 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-3be14b2e-f36a-4848-90da-b43098e0e77d tempest-ProjectReaderTests-1006413965 None] Lock "cinder-3741a7fb-6b8b-4208-aa2f-d6968443434c-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Flow 'volume_create_manager' (bda5da84-02ae-4d1b-9306-0d626a75e2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5081cb-39cc-48ae-8fb6-26ec881e42dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5081cb-39cc-48ae-8fb6-26ec881e42dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783219589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6c5fd8-6189-4868-b9bd-0e205edc941c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c046a67d624d97a26388df0d1587dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:29Z,use_quota=True,user_id='102824f157a64a51943b75108aaf8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bdf307-f4d2-42a1-983d-ad937555df15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bdf307-f4d2-42a1-983d-ad937555df15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699b47d1-0611-4850-aa3b-6d8b524a3757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699b47d1-0611-4850-aa3b-6d8b524a3757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6c5fd8-6189-4868-b9bd-0e205edc941c', 'volume_name': 'volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494cb6cc-86e0-482b-ba92-ecb34fb91ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494cb6cc-86e0-482b-ba92-ecb34fb91ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ddcb74-c5e3-4dd8-8f21-df465fcf7bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:29 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Volume cf6c5fd8-6189-4868-b9bd-0e205edc941c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c', 'volume_size': 1} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783219589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6c5fd8-6189-4868-b9bd-0e205edc941c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c046a67d624d97a26388df0d1587dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:29Z,use_quota=True,user_id='102824f157a64a51943b75108aaf8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Creating volume cf6c5fd8-6189-4868-b9bd-0e205edc941c {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:29 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:05:29 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:29 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c 1073741824 Jul 11 19:05:29 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:30 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c 1073741824" returned: 0 in 0.748s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:30 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c Jul 11 19:05:30 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:30 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c" returned: 0 in 0.616s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:30 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:30 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ddcb74-c5e3-4dd8-8f21-df465fcf7bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f671a9b-d5aa-46ef-85cc-69a65d72a65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:30 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Volume volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c (cf6c5fd8-6189-4868-b9bd-0e205edc941c): created successfully Jul 11 19:05:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f671a9b-d5aa-46ef-85cc-69a65d72a65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:30 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Flow 'volume_create_manager' (bda5da84-02ae-4d1b-9306-0d626a75e2a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:30 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-d872fd2c-194a-4712-b4c0-de3c7b664db7 tempest-ProjectReaderTests-1006413965 None] Created volume successfully. Jul 11 19:05:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:31 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Creating offline snapshot ab596eeb-14f5-4202-9865-64264f8e3dd3 of volume cf6c5fd8-6189-4868-b9bd-0e205edc941c {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:05:31 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be6b1bb-e9cf-4345-afde-a887c7bc0cd0]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:31 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:31 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c Jul 11 19:05:31 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:32 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c" returned: 0 in 0.718s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:32 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 1G Jul 11 19:05:32 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:32 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 1G" returned: 0 in 0.742s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:32 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:32 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 Jul 11 19:05:32 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:33 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3" returned: 0 in 0.643s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:33 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 is being set with open permissions: ugo+rw Jul 11 19:05:33 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:33 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 Jul 11 19:05:33 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:34 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3" returned: 0 in 0.633s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:34 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.info Jul 11 19:05:34 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:34 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.info" returned: 0 in 0.623s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:34 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.info is being set with open permissions: ugo+rw Jul 11 19:05:34 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:34 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.info Jul 11 19:05:34 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:35 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.info" returned: 0 in 0.612s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.043s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:35 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-5baf889a-3ba1-4257-9624-73f04ed71c3d tempest-ProjectReaderTests-1006413965 None] Create snapshot completed successfully Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-ab596eeb-14f5-4202-9865-64264f8e3dd3-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-ab596eeb-14f5-4202-9865-64264f8e3dd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-cf6c5fd8-6189-4868-b9bd-0e205edc941c" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-cf6c5fd8-6189-4868-b9bd-0e205edc941c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-ab596eeb-14f5-4202-9865-64264f8e3dd3" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-ab596eeb-14f5-4202-9865-64264f8e3dd3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Deleting offline snapshot ab596eeb-14f5-4202-9865-64264f8e3dd3 of volume cf6c5fd8-6189-4868-b9bd-0e205edc941c {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] snapshot_file for this snap is: volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5088688-3d51-46d7-b8f9-ce0cc389d6aa]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:35 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:35 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 Jul 11 19:05:35 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:36 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3" returned: 0 in 0.712s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:36 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:05:36 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78cfbbf-274a-40e2-85f6-24c0ecaf0413]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:36 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:36 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c Jul 11 19:05:36 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:37 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c" returned: 0 in 0.738s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:37 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 Jul 11 19:05:37 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:37 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3" returned: 0 in 0.701s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:37 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:37 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3 Jul 11 19:05:37 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:38 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c.ab596eeb-14f5-4202-9865-64264f8e3dd3" returned: 0 in 0.623s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-ab596eeb-14f5-4202-9865-64264f8e3dd3" released by "_delete_snapshot" :: held 2.859s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-cf6c5fd8-6189-4868-b9bd-0e205edc941c" released by "delete_snapshot" :: held 2.879s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Created reservations ['ce668481-9be2-42e3-b048-0730bd6624ab', '246f65d3-8a9e-4d59-b4ea-eabfe2fd3c49', '03f02b98-870e-4d76-ad76-3f1dcb3dd44e', '846fd1c1-0d04-484a-ae58-a7ed124f3fb5'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:38 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Delete snapshot completed successfully. Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-f26c3921-d57f-4f91-ba87-fc963e4e3e32 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-ab596eeb-14f5-4202-9865-64264f8e3dd3-delete_snapshot" released by "delete_snapshot" :: held 3.002s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-cf6c5fd8-6189-4868-b9bd-0e205edc941c-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-cf6c5fd8-6189-4868-b9bd-0e205edc941c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-cf6c5fd8-6189-4868-b9bd-0e205edc941c" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-cf6c5fd8-6189-4868-b9bd-0e205edc941c" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89e483e-3913-441f-87ba-70b92b06fd00]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:38 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:39 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c Jul 11 19:05:39 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:39 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c" returned: 0 in 0.718s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:39 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:39 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c Jul 11 19:05:39 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:40 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-cf6c5fd8-6189-4868-b9bd-0e205edc941c" returned: 0 in 0.610s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-cf6c5fd8-6189-4868-b9bd-0e205edc941c" released by "delete_volume" :: held 1.381s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Created reservations ['2a051ffe-8f7a-4d11-b794-7af6344deb82', 'cc67bdc6-1d8f-4a12-87bc-dfaab7bae3af', 'd12b6be2-6cf8-4bb5-9c81-ba90fb5404e7', 'edf2386f-109b-41a0-aae2-adf7371bfd07'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:40 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:05:40 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:40 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.605s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:40 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:40 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Deleted volume successfully. Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-98d3a8f7-4d27-497a-9e68-f8a957f40f42 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-cf6c5fd8-6189-4868-b9bd-0e205edc941c-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.flows.manager.create_volume [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87411) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Flow 'volume_create_manager' (b54cc7d3-e8cc-4291-9634-cbe2a690ba76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc42dc1b-e261-4128-8ec8-aee07fa85759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc42dc1b-e261-4128-8ec8-aee07fa85759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893152701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff323788-8805-403c-92fc-cb34672e5e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c046a67d624d97a26388df0d1587dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:41Z,use_quota=True,user_id='102824f157a64a51943b75108aaf8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1cd0412-f066-49c8-87e7-335988c4d85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1cd0412-f066-49c8-87e7-335988c4d85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cb6a6b-a3fc-4f40-a93f-74764a848efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cb6a6b-a3fc-4f40-a93f-74764a848efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff323788-8805-403c-92fc-cb34672e5e92', 'volume_name': 'volume-ff323788-8805-403c-92fc-cb34672e5e92', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0e10df-fea1-4bd8-a2eb-aae1e2960fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0e10df-fea1-4bd8-a2eb-aae1e2960fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54317de6-efd0-4d72-9fc7-f670e287a368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:41 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Volume ff323788-8805-403c-92fc-cb34672e5e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff323788-8805-403c-92fc-cb34672e5e92', 'volume_size': 1} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T17:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893152701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff323788-8805-403c-92fc-cb34672e5e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c046a67d624d97a26388df0d1587dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T17:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T17:05:41Z,use_quota=True,user_id='102824f157a64a51943b75108aaf8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6),volume_type_id=ed8b822a-dccc-4d69-9902-ed6f0b7fd7c6)}" {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Creating volume ff323788-8805-403c-92fc-cb34672e5e92 {{(pid=87411) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Selected osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e as target Quobyte volume. {{(pid=87411) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 19:05:41 devstack cinder-volume[87411]: INFO cinder.volume.drivers.remotefs [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] casted to osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e Jul 11 19:05:41 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 1073741824 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:41 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 1073741824 Jul 11 19:05:41 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:42 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 1073741824" returned: 0 in 0.779s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:42 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:42 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 Jul 11 19:05:42 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:43 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92" returned: 0 in 0.622s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'} {{(pid=87411) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54317de6-efd0-4d72-9fc7-f670e287a368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff323788-8805-403c-92fc-cb34672e5e92', 'volume_size': 1}' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b363079-1ee3-4922-a431-63a4407052ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 19:05:43 devstack cinder-volume[87411]: INFO cinder.volume.flows.manager.create_volume [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Volume volume-ff323788-8805-403c-92fc-cb34672e5e92 (ff323788-8805-403c-92fc-cb34672e5e92): created successfully Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b363079-1ee3-4922-a431-63a4407052ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87411) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Flow 'volume_create_manager' (b54cc7d3-e8cc-4291-9634-cbe2a690ba76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87411) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 19:05:43 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-813029fc-d881-4d37-bd03-e99cdb1b71e8 tempest-ProjectReaderTests-1006413965 None] Created volume successfully. Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Creating offline snapshot a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 of volume ff323788-8805-403c-92fc-cb34672e5e92 {{(pid=87411) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9457f3-aab7-467d-99ae-9c8e880224a3]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:43 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:43 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 Jul 11 19:05:43 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:44 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92" returned: 0 in 0.721s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:44 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 1G {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:44 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 1G Jul 11 19:05:44 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:45 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 1G" returned: 0 in 0.746s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff323788-8805-403c-92fc-cb34672e5e92 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:45 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff323788-8805-403c-92fc-cb34672e5e92 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 Jul 11 19:05:45 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:45 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff323788-8805-403c-92fc-cb34672e5e92 -F qcow2 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6" returned: 0 in 0.647s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:45 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 is being set with open permissions: ugo+rw Jul 11 19:05:45 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:45 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 Jul 11 19:05:45 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:46 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6" returned: 0 in 0.607s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:46 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:46 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.info Jul 11 19:05:46 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:47 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.info" returned: 0 in 0.621s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:47 devstack cinder-volume[87411]: WARNING cinder.volume.drivers.remotefs [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.info is being set with open permissions: ugo+rw Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.info {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:47 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.info Jul 11 19:05:47 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:47 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.info" returned: 0 in 0.603s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.017s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:47 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-10454aaa-1564-47d1-8940-0cf1e80ff73a tempest-ProjectReaderTests-1006413965 None] Create snapshot completed successfully Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6-delete_snapshot" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Lock "cinder-a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-ff323788-8805-403c-92fc-cb34672e5e92" by "delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-ff323788-8805-403c-92fc-cb34672e5e92" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6" by "_delete_snapshot" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Deleting offline snapshot a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 of volume ff323788-8805-403c-92fc-cb34672e5e92 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] snapshot_file for this snap is: volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 {{(pid=87411) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ed004b-ee94-4db3-98c7-807463d35192]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:47 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:48 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 Jul 11 19:05:48 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:48 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6" returned: 0 in 0.725s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:48 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.remotefs [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff323788-8805-403c-92fc-cb34672e5e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87411) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 19:05:48 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b971274-53b1-41bf-b971-8d879ba4ac4c]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:48 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:48 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 Jul 11 19:05:48 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:49 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92" returned: 0 in 0.705s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:49 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:49 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 Jul 11 19:05:49 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:50 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6" returned: 0 in 0.697s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:50 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6 Jul 11 19:05:50 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:50 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:50 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92.a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6" returned: 0 in 0.608s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6" released by "_delete_snapshot" :: held 2.821s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-ff323788-8805-403c-92fc-cb34672e5e92" released by "delete_snapshot" :: held 2.846s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:50 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Created reservations ['cb49f53c-ded1-4119-8237-b3b68a2ff944', '7fa1af43-2888-41bf-a81d-bff02aa19c83', 'd65499ce-7759-4657-b54e-1ef44dc0d205', '2f91dcc6-1e21-41b9-ba65-a2ce088ba6ef'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:50 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Delete snapshot completed successfully. Jul 11 19:05:50 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-8db004b8-72b2-4e27-988c-4184da9a8aba tempest-ProjectReaderTests-1006413965 None] Lock "cinder-a9a66cfb-5e7f-4c0a-8c93-f83d73499ad6-delete_snapshot" released by "delete_snapshot" :: held 2.969s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-ff323788-8805-403c-92fc-cb34672e5e92-delete_volume" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-ff323788-8805-403c-92fc-cb34672e5e92-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "cinder-quobyte-ff323788-8805-403c-92fc-cb34672e5e92" by "delete_volume" {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-ff323788-8805-403c-92fc-cb34672e5e92" acquired by "delete_volume" :: waited 0.016s {{(pid=87411) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61cdb66-a66f-4705-9e1e-249db525da87]: (4, 'qcow2') {{(pid=88221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:51 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 Jul 11 19:05:51 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:51 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:05:51 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:51 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92" returned: 0 in 0.722s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:51 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:51 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92 Jul 11 19:05:51 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:52 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.636s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG oslo_service.periodic_task [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] Running periodic task VolumeManager._thread_info {{(pid=87411) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread count: 28 {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG cinder.volume.manager [None req-e6e46a51-ae66-47e9-9c2b-d62553e71229 None None] thread info: [<_MainThread(MainThread, started 128555304476800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87411) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 19:05:52 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd/volume-ff323788-8805-403c-92fc-cb34672e5e92" returned: 0 in 0.631s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-quobyte-ff323788-8805-403c-92fc-cb34672e5e92" released by "delete_volume" :: held 1.407s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG cinder.quota [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Created reservations ['98996147-03a2-4d72-9ad9-cd6d947d9f9f', 'e076463c-6010-4969-ba0b-035d59249348', 'c9d87527-e27f-4cf1-88bf-91dda6de0a2c', '6113e51d-70b0-402e-ac54-e654436160ad'] {{(pid=87411) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e': None} {{(pid=87411) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG cinder.volume.drivers.quobyte [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-33910649-c63e-4c82-a6ea-1533bb95c38e'] {{(pid=87411) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.lockutils [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87411) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 19:05:52 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 19:05:52 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd Jul 11 19:05:52 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 19:05:53 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 11 19:05:53 devstack cinder-volume[87411]: DEBUG oslo_concurrency.processutils [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dffd5424e43375c419e846c2bb3ac7fd" returned: 0 in 0.637s {{(pid=87411) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 19:05:53 devstack cinder-volume[87411]: DEBUG cinder.manager [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Notifying Schedulers of capabilities ... {{(pid=87411) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 19:05:53 devstack cinder-volume[87411]: INFO cinder.volume.manager [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Deleted volume successfully. Jul 11 19:05:53 devstack cinder-volume[87411]: DEBUG cinder.coordination [None req-4a0fcdbf-d959-40d6-bbad-95cc3fac6b55 tempest-ProjectReaderTests-1006413965 None] Lock "cinder-ff323788-8805-403c-92fc-cb34672e5e92-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87411) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 19:06:03 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=69,cinder:DELETE=8,cinder:SELECT=54,cinder:INSERT=21 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 19:06:03 devstack cinder-volume[87411]: DEBUG dbcounter [-] [87411] Writing DB stats cinder:UPDATE=71,cinder:SELECT=55,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}